A method includes determining a voxel grid representation of occupied voxels of an environment of a robotic device based on sensor data from a depth sensor on the robotic device. The method further includes assigning a plurality of occupied voxels from the voxel grid representation to a surface within the environment. The method additionally includes determining an image to project onto the surface with a projector on the robotic device. The method further includes modifying the image to fit the surface within the environment based on the plurality of occupied voxels assigned to the surface. The method also includes causing the projector coupled to the robotic device to project the modified image onto the surface in the environment.

A robotic system is disclosed that includes an articulated arm with an end effector. The robotic system is for use in a robotic environment requiring interaction with persons in the robotic environment, and includes a plurality of lights that are illuminated responsive to known near-future movements of the articulated arm to convey the known near-future movements of the articulated arm to the persons in the robot environment.

A distance-measuring system includes: a first ranging sensor; a second ranging sensor that covers a detection range more limited than a detection range covered by the first ranging sensor and has resolution higher than resolution of the first ranging sensor; and an image processing device. The image processing device includes: a machine detector that detects a position of a mobile machine, based on a first sensed result obtained by the first ranging sensor; a sensor controller that controls a detection position to be detected by the second ranging sensor to detect the position of the mobile machine which has been detected; and a safety determiner that controls the mobile machine, based on a second sensed result obtained by the second ranging sensor.

A workbench system comprising: a workbench; a sensor system comprising one or more sensors, the sensor system configured to identify a user in a workspace in which the workbench is located; a controller operatively coupled to the sensor system and configured to: based on the identity of the user, determine a task to be performed by the user using the workbench system; and based on the identity of the user and the determined task, control one or more properties of the workbench.

Disclosed is an electronic device. The electronic device includes a display; a camera; a sensor; a storage configured to store position information and work information of a smart machine; and a processor configured to identify a smart machine which is located within a peripheral area of the electronic device based on position information of the electronic device sensed through the sensor and position information of the smart machine stored in the storage, to obtain work information of the identified smart machine from the storage, and to indicate a work area of the smart machine on an image photographed through the camera based on the obtained work information of the smart machine and provide the image including the work area on the display.

Systems and methods for determining safe and unsafe zones in a workspacewhere safe actions are calculated in real time based on all relevant objects (e.g., some observed by sensors and others computationally generated based on analysis of the sensed workspace) and on the current state of the machinery (e.g., a robot) in the workspacemay utilize a variety of workspace-monitoring approaches as well as dynamic modeling of the robot geometry. The future trajectory of the robot(s) and/or the human(s) may be forecast using, e.g., a model of human movement and other forms of control. Modeling and forecasting of the robot may, in some embodiments, make use of data provided by the robot controller that may or may not include safety guarantees.

A method for operating a robotic arm using a first visualization device includes visually indicating, on the robotic arm and/or in the workspace of the robotic arm and/or on a work surface below the robotic arm, an imminent adjustment of at least one axis of the robotic arm, in particular of at least one axis closest to the robotic arm base.

A robotic system is disclosed that includes an articulated arm with an end effector. The robotic system is for use in a robotic environment requiring interaction with persons in the robotic environment, and includes a plurality of lights that are illuminated responsive to known near-future movements of the articulated arm to convey the known near-future movements of the articulated arm to the persons in the robot environment.

A robotic system is disclosed that includes an articulated arm with an end effector. The robotic system is for use in a robotic environment requiring interaction with persons in the robotic environment, and includes a plurality of lights that are illuminated responsive to known near-future movements of the articulated arm to convey the known near-future movements of the articulated arm to the persons in the robot environment.

A robotic system is disclosed that includes an articulated arm with an end effector. The robotic system is for use in a robotic environment requiring interaction with persons in the robotic environment, and includes a plurality of lights that are illuminated responsive to known near-future movements of the articulated arm to convey the known near-future movements of the articulated arm to the persons in the robot environment.