A computing device comprises a memory and a control unit coupled to the memory. The control unit is configured to receive a patient model and identify a plurality of port locations on the patient model for accessing a workspace using a plurality of instruments controlled by a computer-assisted device. For each of the port locations, the control unit determines a collision volume for portions of the computer-assisted device proximal to the port location, a reachability metric, and an anthropomorphic metric. For each combination of the plurality of port locations, the control unit determines a collision metric based on overlaps of the collision volumes for the port locations in the combination, and an aggregate metric for the combination. The control unit is also configured to display one or more of the combinations of the plurality of port locations to a user along with a corresponding aggregate metric.

A force transmission mechanism includes a chassis that supports a rotatable arm, which includes a slot. A rotatable lever is supported by the chassis. A protrusion at an end of the lever engages the slot. A sliding drive element is supported by the chassis. A proximal termination of the drive element engages a second end of the lever. The chassis may support an elongate tube with an end effector fixed to the tube. The drive element may extend through the elongate tube. The elongate tube may rotate relative to the chassis. The drive element may rotate in unison with the elongate tube with the proximal termination rotating relative to the fork. The drive element may be a tube that provides a fluid passage to the end effector. The lever may be a bell crank with arms at a right angle.

Disclosed embodiments provide techniques for virtual reality enabled activity allocation. A camera system monitors a physical environment from multiple angles, generating real-time video feeds of the physical environment. A real-time virtual reality environment (RTVRE) rendering system utilizes the real-time video feeds as input to create a virtual reality environment that is representative of the physical environment. A user performs an action in the virtual environment that corresponds to a task to be performed in the physical environment. A computer-implemented virtual reality control management system assesses the task and assigns the task to an electromechanical device that is best-suited to perform the task, based on a scoring algorithm. This enables actions such as remote monitoring and control of a premises. Thus, disclosed embodiments improve the technical field of remote monitoring and control of a premises.

Robots, methods, and computer program products for training and operating (semi-) autonomous robots to complete multiple different work objectives are described. A robot accesses a library of reusable work primitives from a catalog of libraries of reusable work primitives, each reusable work primitive corresponding to a respective basic sub-task or sub-action that the robot is operative to autonomously perform. A work objective is analyzed to determine a sequence (i.e., a combination and/or permutation) of reusable work primitives that, when executed by the robot, will complete the work objective. The robot executes the sequence of reusable work primitives to complete the work objective. A robot can be deployed with an appropriate stored library (or access to an appropriate library) of reusable work primitives, based on what the robot is expected to do, or what service category or role the robot will operate in.

A method, apparatus, and computer-readable storage media for robotic programming are disclosed. To improve upon or even solve the dilemma that teach-in techniques cannot work for all kinds of objects and offline programming requires complicated simulation of a robot and objects, a solution is provided to use a virtual item marked by a marker during programming of the robot and display the virtual item to a user. As such, even very large items can be used and also replaced easily during programming, which makes the programming procedures go smoothly and efficiently.

A proximity sensing autonomous robotic system and apparatus is provided. The robot includes one or more vision modules for viewing the environment for depth perception, object detection, object avoidance and temperature detection of objects. A proximity sensing skin is laminated on one or more parts of the robot. The proximity sensing skin includes a plurality of proximity sensors and mechanical stress sensors for collision avoidance, speed control and deceleration of motion near detected objects, and touch recognition. The proximity sensing skin may include conductive pads for contacting different materials in a composite part to inhibit galvanic corrosion. The robot includes an end effector to which different tools may be attached for performing different tasks. The end effector includes a mounting interface with connections for supplying power and hydraulic/pneumatic control of the tool. All wiring to the sensors and vision modules are routed internally within the robot.

A controller is capable of controlling an asset or target in physical and/or virtual three-dimensional space using a single hand by generating control inputs in four or more degrees of freedom while also limiting cross-coupling (unintended motions). The controller includes a first control member is configured to be gripped in a user's single, second control member is disposed on or near a top end of the first member movable with at least one degree of freedom independently of the movement of the first control member, and a third control member positioned on the first member for displacement by one or more digits of the user's single hand and coupled with the second member to move in opposition to movement of the second control member.

A remote control manipulator system includes a manipulator controlled remotely by an operator; a camera to capture an image including the manipulator; a posture sensor to detect posture data; an action instruction inputter with which the operator inputs an action instruction instructing action to move or stop the manipulator; a control device including a structural data storage to store manipulator structural data representing a structure of the manipulator, a model image generator to generate a model image with referring to the structural data storage and the posture data, and a presentation image generator to generate a presentation image by superimposing a model image on the captured image; and a display to display the presentation image.

A system and method of assisting operator engagement with input devices includes a repositionable structure configured to support a physical input device, a hand detection system, and a control unit. The repositionable structure includes one or more actuators. The physical input device is configured to be operated by a hand of an operator. The control unit is configured to detect the hand of the operator using the hand detection system and in response to a trigger condition, command the one or more actuators to move the input device from a first orientation to a second orientation, wherein the second orientation is closer to a grasping orientation of the hand than the first orientation is to the grasping orientation of the hand.

A surgical robotic system offers automation templates, such as surgical task templates, for collaborative control of the robot arms operating in an automated manner. This automated operation through integration of template selection and programming may reduce fatigue while maintaining accuracy and dexterity. For more routine parts of the surgery, the surgeon may select a template and use the template interface to set various parameters for a given surgery, such as the force to be applied, order of tasks, trajectory of movement, stop points, and/or distance of any given movement in automatic operation for surgeon verification. By automating parts of the surgery, the surgeon may use direct control for more sensitive aspects of the surgery while having a respite or assistance for more routine aspects of the surgery.