An augmented reality (AR) system for visualizing and modifying robot operational zones. The system includes an AR device such as a headset in communication with a robot controller. The AR device includes software for the AR display and modification of the operational zones. The AR device is registered with the robot coordinate frame via detection of a visual marker. The AR device displays operational zones overlaid on real world images of the robot and existing fixtures, where the display is updated as the user moves around the robot work cell. Control points on the virtual operational zones are displayed and allow the user to reshape the operational zones. The robot can be operated during the AR session, running the robot's programmed motion and evaluating the operational zones. Zone violations are highlighted in the AR display. When zone definition is complete, the finalized operational zones are uploaded to the robot controller.

A teach pendant includes an input unit and allowing teaching of operation of a robot by an input to the input unit, the teach pendant further includes a measurement reference surface which comes into surface contact with a measured surface of the robot, a tilt sensor whose position is fixed with respect to the measurement reference surface, and an output means which outputs a detection value of the tilt sensor to a control device of the robot in a state where the measurement reference surface is in surface contact with the measured surface and when a predetermined input operation is performed on the input unit or a contact detection sensor for detecting surface contact between the measurement reference surface and the measured surface detects the surface contact.

Example systems and methods allow for runtime control of robotic devices during a construction process. One example method includes determining at least one sequence of robot operations corresponding to at least one robot actor, causing the at least one robot actor to execute a portion of the at least one sequence of robot operations during a first time period, receiving an interrupt signal from a mobile computing device indicating a modification to the at least one sequence of robot operations, where the mobile computing device is configured to display a digital interface including one or more robot parameters describing the at least one robot actor and one or more tool parameters describing operating characteristics of at least one physical tool, and causing the at least one robot actor to execute a portion of the at least one modified sequence of robot operations during a second time period.

A robot system includes a manufacturing system including a robot and peripheral equipment. There is a controller communicably connected to the robot, the peripheral equipment, and a portable information terminal. The controller includes a memory storing the operation program, operation mode setting circuitry to set an operation mode a teaching mode or a playback mode, operation controlling circuitry configured to control the operation of the robot in the teaching mode based on the operation command, and control the robot and the peripheral equipment in the playback mode in accordance with the operation program, and display controlling circuitry configured to control the portable information terminal in the teaching mode to display on a display an operation screen through which the operation command is inputted, and control the portable information terminal in the playback mode to display on the displaying part a screen different from the operation screen.

An industrial robot system including a dual arm robot having two arms independently movable in relation to each other, and a hand-held control device for controlling the robot and provided with a visual display unit for displaying information about the arms. The control device is provided with a measuring device for measuring the orientation of the control device, and the control device is configured to display information about one of the arms in a first area on the display unit and to display information about the other arm in a second area on the display unit, and to change the positions of the first and second areas in dependence on the orientation of the control device in relation to the robot so that the positions of the first and second area on the display unit reflects the orientation of the control device in relation to the positions of the arms.

A machine learning device, which learns shocks to a teaching device, includes a state observation unit which observes data based on an inclination of the teaching device or a present position of the teaching device; a label obtaining unit which obtains a label based on a shock received by the teaching device; and a learning unit which generates a learning model based on an output of the state observation unit and an output of the label obtaining unit.

A teach pendant for teaching a robot includes an operation unit disposed on a first surface of the teach pendant, to perform an input operation; a display unit disposed on the first surface; and a camera disposed on a second surface opposite the first surface of the teach pendant. An image captured by the camera is displayed on the display unit.

A teaching system configured to teach operation to a plurality of robots includes a first controlling device which determines whether a first robot and a second robot are in an enabled state where the first and second robots are permitted to operate, and when the first controlling device determines as in the enabled state, the first controlling device transmits an enable signal indicative of permitting the second robot to operate and enables the first robot to be taught the operation when a teaching terminal specifies the first robot. When a second controlling device receives the enable signal from the first controlling device and the teaching terminal specifies the second robot, the second controlling device enables the second robot to be taught the operation.

A method includes receiving sensor data for an environment about the robot. The sensor data is captured by one or more sensors of the robot. The method includes detecting one or more objects in the environment using the received sensor data. For each detected object, the method includes authoring an interaction behavior indicating a behavior that the robot is capable of performing with respect to the corresponding detected object. The method also includes augmenting a localization map of the environment to reflect the respective interaction behavior of each detected object.

A machine learning device of a controller observes, as state variables expressing a current state of an environment, teaching position compensation amount data indicating a compensation amount of a teaching position in control of a robot according to the teaching position and data indicating a disturbance value of each of the motors of the robot in the control of the robot, and acquires determination data indicating an appropriateness determination result of the disturbance value of each of the motors of the robot in the control of the robot. Then, the machine learning device learns the compensation amount of the teaching position of the robot in association with the motor disturbance value data by using the observed state variables and the determination data.