System includes: an operation terminal that (i) receives an operation instruction that is given by the operator to a movable section of a machine and (ii) senses an operation standby state that allows the operation instruction to be received; an image sensor estimating section configured to estimate a positional relationship between the operator and the machine; a model generating section configured to, in response to sensing of the operation standby state by the operation terminal, generate an operating direction indicating image; and in accordance with the positional relationship, in a direction that is in accordance with a direction in which the operator views the machine, the operating direction indicating image indicating an operating direction of the movable section; an combining section configured to generate a combined image obtained by combining the operating direction indicating image with a captured image of the movable section that has been photographed.

A teach pendant for teaching a robot includes an operation unit disposed on a first surface of the teach pendant, to perform an input operation; a display unit disposed on the first surface; and a camera disposed on a second surface opposite the first surface of the teach pendant. An image captured by the camera is displayed on the display unit.

A method for assigning a workpiece to be processed to a mobile unit of an indoor location system used in a manufacturing hall in industrial processing of workpieces is provided. The method includes: providing a manufacturing control system for the industrial processing of workpieces with a machine tool in accordance with workpiece-specific processing plans, providing an assistance system for collecting measurement assistance workpiece data sets for the workpieces, detecting a workpiece to be assigned with the assistance system and generating a measurement-assistance-workpiece data set for the workpiece, comparing the measurement-assistance-workpiece data set with a processing plan-assistance-workpiece data set corresponding to the workpiece to identify a processing plan, providing a mobile unit assigned to the identified processing plan, the indoor location system configured to determine a position of the mobile unit, and spatially assigning the workpiece to the mobile unit assigned to the identified processing plan.

A method for assigning a processing plan to a mobile unit data set of a mobile unit of an indoor location system of a manufacturing hall is provided. The method includes: providing a manufacturing control system for industrial processing of workpieces with a machine tool in accordance with workpiece-specific processing plans, each processing plan storing order information for a workpiece to be processed, providing a mobile unit with an image acquisition unit for acquiring image data, mobile unit data set belonging to the mobile unit and position data of the mobile unit acquired with the indoor location system being stored in the manufacturing control system, acquiring image data of a processing plan-specific object for identifying the processing plan to be assigned with the manufacturing control system, and assigning the identified processing plan to the mobile unit data set of the mobile unit in the manufacturing control system.

A control system for mechanical equipment is provided with: a manual operation mechanism provided with a minimum required number of operation switches and a mechanical equipment identification signal transmission unit for transmitting a mechanical equipment identification signal that identifies mechanical equipment; an operation assistance terminal in which the mechanical equipment identification signal received from the transmission unit is used as a basis to display a manual operation assistance screen including a manually operated device selection section and a control content display section that displays control content assigned to the operation switches of the manual operation mechanism for a selected manually operated device; and a control device that connects the control unit of an identified control target device and the operation switches of the manual operation mechanism by receiving a control target device switching signal identified by operation of the manually operated device selection section.

A work supporting apparatus includes: a visible light camera (visible light image photographing unit) configured to photograph a visible light image; a far-infrared camera (thermal image photographing unit) configured to photograph a thermal image; a work progress status determining unit configured to determine a work progress status from the visible light image photographed by the visible light camera and the thermal image photographed by the far-infrared camera; and a display configured to display a determination result of the work progress status.

A coordinate information conversion device includes: calculation means for acquiring a plurality of pieces of image data obtained by capturing a set of positions including a position of a fixed object and a position of a movable part of a machine tool and calculating values of undefined numbers included in a predetermined conversion equation on the basis of the acquired plurality of pieces of image data; and first conversion means for converting a coordinate value in a first coordinate system which is a coordinate system for controlling driving of the movable part to a coordinate value in a second coordinate system which is a coordinate system for representing virtual information and is a coordinate system based on the position of the fixed object on the basis of the predetermined conversion equation of which the values of the undefined numbers are calculated by the calculation means.

A work supporting apparatus includes: a visible light camera (visible light image photographing unit) configured to photograph a visible light image; a far-infrared camera (thermal image photographing unit) configured to photograph a thermal image; a work progress status determining unit configured to determine a work progress status from the visible light image photographed by the visible light camera and the thermal image photographed by the far-infrared camera; and a display configured to display a determination result of the work progress status.

An augmented reality (AR) system for visualizing and modifying robot operational zones. The system includes an AR device such as a headset in communication with a robot controller. The AR device includes software for the AR display and modification of the operational zones. The AR device is registered with the robot coordinate frame via detection of a visual marker. The AR device displays operational zones overlaid on real world images of the robot and existing fixtures, where the display is updated as the user moves around the robot work cell. Control points on the virtual operational zones are displayed and allow the user to reshape the operational zones. The robot can be operated during the AR session, running the robot's programmed motion and evaluating the operational zones. Zone violations are highlighted in the AR display. When zone definition is complete, the finalized operational zones are uploaded to the robot controller.

The invention relates to a method of operating a machine system (1) comprising a plurality of machines (2). Said machines (2) are in particular machine tool devices with numerical control, NC, or programmable logic controller, PLC, control systems and are connected to a computing system (3) of the machine system (1). The machine system (1) further comprises human-machine-interfaces (8; 9; 10; 11) to present machine (2) information and at least one operator detection unit (6; 7). Said operator detection unit (6; 7) detects a machine operator (4) being in the proximity of a machine (2) and/or walking past a machine (2) and collects operator behavior data (5). The operator detection unit (6; 7) sends the collected operator behavior data (5) to the computing system (3) which selects information to be presented to the machine operator (4) in dependence on the operator behavior data (5) and selects at least one of the human-machine-interfaces (8; 9; 10; 11) to present said information. Finally, the respective human-machine-interfaces (8; 9; 10; 11) present the selected information.