A manipulator system includes a manipulator configured for guiding an instrument. The system furthermore includes a controller configured to actuate the manipulator such that the instrument is pressed with a pressing force against a human body. A force reduction input device is provided separately from the manipulator and is operable by an operator to reduce the pressing force.

A master-slave system includes: a master unit including an operation end, an operation detector that detects operational information inputted by a force being applied to the operation end, and a force applier that gives a force to the operation end; a slave unit including an action part, and an operation part that moves the action part; and a control device. The control device outputs, according to a regulating condition and the operational information, a command for causing the operation part to operate the action part to carry out operation reflecting the regulating condition. The control device outputs, according to the regulating condition, a command for causing the force applier to give a force to the operation end against the input to the operation end that commands the given movement of the action part.

The present disclosure discloses an autonomous mobile grabbing method for a mechanical arm based on visual-haptic fusion under a complex illumination condition, which mainly includes approaching control over a target position and feedback control over environment information.

According to the method, under the complex illumination condition, weighted fusion is conducted on visible light and depth images of a preselected region, identification and positioning of a target object are completed based on a deep neural network, and a mobile mechanical arm is driven to continuously approach the target object; in addition, the pose of the mechanical arm is adjusted according to contact force information of a sensor module, the external environment and the target object; and meanwhile, visual information and haptic information of the target object are fused, and the optimal grabbing pose and the appropriate grabbing force of the target object are selected.

By adopting the method, the object positioning precision and the grabbing accuracy are improved, the collision damage and instability of the mechanical arm are effectively prevented, and the harmful deformation of the grabbed object is reduced.

A surgical system comprises an articulated mechanical arm comprising arm segments connected serially by arm joints that flex and rotate, and first and second input-devices. The second input-device comprises a handle configurable to be oriented in any orientation in an x-y-z space, and the handle comprises segment members and joint members corresponding to the arm segments and arm joints of the arm. The arm joints can be actuatable by, and have the same degrees of freedom as, the handle joint member. A method of using the surgical system includes retroflecting the arm, transitioning control of the arm from the first input device to the second input device, and performing a surgical action, during which a displacement vector or a reorientation arc of the handle member through the x-y-z space is translated to a corresponding displacement vector or corresponding reorientation arc of the end effector in the same x-y-z space.

Implementations relate to detecting user touch on a controller handle. In some implementations, a non-controlling mode of a control system is activated, and in the non-controlling mode, one or more actuators are controlled to cause a vibration to be provided on a handle of a controller. The vibration is sensed with one or more sensors, and a difference in the vibration is determined to have occurred relative to a reference vibration using the one or more sensors, where the difference satisfies one or more predetermined thresholds. A controlling mode of the system is activated in response to determining the difference in the vibration, and the vibration is modified on the handle in response to detecting the change in the vibration.

Embodiments of the present disclosure provide a system, method, apparatus and computer-readable medium for teleoperation. An exemplary system includes a robot machine having a machine body, at least one sensor, at least one robot processor, and at least one user processor operable to maintain a user simulation model of the robot machine and the environment surrounding the robot machine, the at least one user processor being remote from the robot machine. The system further includes at least one user interface comprising a haptic user interface operable to receive user commands and to transmit the user commands to the user simulation model, a display operable to display a virtual representation of the user simulation model.

A robot system includes a manipulating force detector configured to detect a manipulating force given to an operation end by an operator, a reaction-force detector configured to detect a reaction force given to a work end or a workpiece held by the work end, a system controller configured to generate an operating command of a master arm and generate an operating command of a slave arm based on the manipulating force and the reaction force, a master-side control part configured to control the master arm, and a slave-side control part configured to control the slave arm. The system controller has an exaggerated expresser configured to exaggeratedly present an operating feel to the operator who operates the operation end in a reaction-force sudden change state that is a state in which the reaction force changes rapidly with time.

Systems and methods for motion mode management include a computer-assisted device having an input control, a repositionable structure, and a controller coupled to the input control and the repositionable structure. The controller is configured to detect motion of the input control for controlling motion of the repositionable structure and in response to determining that the motion of the input control is likely to be confused with a first portion of a motion of the input control for indicating that a mode of operation of the computer-assisted device is to be changed, temporarily disable mode switching in response to motion of the input control.

Systems and methods for controlling motion of remotely operated equipment such that a motion path is automatically determined for a plurality of joints of the remotely operated equipment based on an updated target position input received from an operator, a current position of the remotely operated equipment, and predetermined parameters indicative of the geometry of the plurality of joints. An optimized motion path may be provided that avoids detected obstacles and joint singularities of the remotely operated equipment.

An electronic device such as an accessory-mountable robot is provided. The electronic device changes functional properties thereof in accordance with a mounted accessory. In an embodiment, the electronic device detects mounting of at least one accessory and identifies accessory characteristics associated with the at least one accessory. Then, the electronic device determines properties of the electronic device associated with the at least one accessory, based on the accessory characteristics, and changes the properties of the electronic device, based on the determined properties. Also, the electronic device outputs at least one of a visual element, an auditory element, or a tactile element associated with the at least one accessory, based on the changed properties.