A system (1) for the virtual assistance of an operator of a processing apparatus (B1, B2, B3) for processing workpieces (W) which preferably consist at least in sections of wood, wood materials, synthetic material or the like, comprising: a mobile terminal device (10) which is configured to be worn by the operator, and that has: position detection means (11) which are configured to detect data for determining the position of the mobile terminal device (10) in relation to the processing apparatus (B1, B2, B3), information output means (12) which are configured to output information and/or operational instructions to the operator, and a preferably wireless data transmission interface (13) which is configured to communicate with a data server (20).

An operation computer displays, in a display such as a head-mounted display, a field of view image that shows what appears in a field of view of an operator if the operator present in a first space is in a second space where a robot is present. The operation computer then controls the robot to perform a task in accordance with a motion of the operator.

A system includes an interventional device, a tracking device, an optical tracking system, at least one processor, and a display unit. The interventional device includes an insertion portion and an exterior portion. The insertion portion is configured for use inside of a patient to perform an interventional procedure. The tracking device is disposed proximate to the exterior portion of the interventional device. The optical tracking system is configured to cooperate with the tracking device to provide tracking imaging corresponding to a location and orientation of the tracking device. At least one processor is configured to correlate the tracking imaging information with an anatomical image of the patient to provide a combined image during a medical task for which at least a portion of the insertion portion of the interventional device is disposed inside of the patient. The display unit is configured to display the combined image.

The present disclosure relates to an operating system for a machine of a food industry. The operating system includes eyeglasses for a user of the operating system and a transceiver for exchanging data between the operating system and the machine. The eyeglasses include a display system configured to display a control element and information of a human machine interface (HMI). Furthermore, the operating system includes at least one input module which receives user input from the user with respect to the control element. The operating system additionally includes a processing module. The processing module converts the received user input into an input signal for controlling at least one of the machine or the HMI.

An information transfer mechanism includes processing apparatus and a head-mounted display, and transfers information of the processing apparatus to an operator. The processing apparatus has an information transmitter for transmitting positional information of the processing apparatus, individual identification information of the processing apparatus, and notice information to be notified to the operator. The head-mounted display receives the notice information of the processing apparatus which have entered a visual field thereof and displays the received notice information in overlapping relation to the scene of peripheral processing apparatus.

A transmissive head-mount type display device including a display configured to display a virtual image, and capable of transmitting an external sight. The head-mounted display including at least one processor or circuit configured to obtain an object located in a predetermined distance range from the display, and a position of a specific object included in the external sight, control the display to display a virtual image associated with the obtained object, identify a change in the position of the specific object based on a position of the specific object obtained, select the object based on a relationship between the change in the position of the specific object identified and a position of the object obtained, and control the display to display a specific check image associated with the object selected as the virtual image.

A system employing a plurality of brain/body-generated inputs to control multi-action operation includes a controllable device, that performs at least two actions via remote control, and a head-mounted user interface device. The UI device includes a user cranium-mounted frame, first and second sensors supported by the frame, a processor, and a transmitter. The first sensor includes an electrode for contacting the cranium when the frame is worn and adapted to receive a bioelectric signal from the cranium. The second sensor receives hands-free brain/body input from the user. The processor uses application software process input provided by the first and second sensors and generates different outputs, corresponding to different commands. The transmitter transmits signals, based on the different commands, to the controllable device to initiate the different actions performed by the device.

A transmissive head-mount type display device including a display configured to display a virtual image, and capable of transmitting an external sight. The head-mounted display including at least one processor or circuit configured to obtain an object located in a predetermined distance range from the display, and a position of a specific object included in the external sight, control the display to display a virtual image associated with the obtained object, identify a change in the position of the specific object based on a position of the specific object obtained, select the object based on a relationship between the change in the position of the specific object identified and a position of the object obtained, and control the display to display a specific check image associated with the object selected as the virtual image.

A wearable device is disclosed. The wearable device comprises a camera, a display device, and a controller. The controller is configured to receive, from the camera, a video stream that depicts a user performing an operation and process, using an operation performance model, a set of frames of the video stream that indicates a state of a performance of the operation by the user. The controller is also configured to determine, based on the state of the performance by the user, a next task of the operation; obtain task information associated with performance of the next task of the operation; and cause, based on the task information, the display device to present instructional information associated with facilitating performance of the next task of the operation. The operation performance model is trained based on a plurality of historical videos indicative of historical performances of the operation by other users.

An automation system controls an automated production process of an industrial plant. The system includes an augmented reality system, including augmented reality glasses and executable program logic coupled to the augmented reality glasses. The executable program logic is configured to receive an up-to-date spatial position of a user wearing the augmented reality glasses from a positioning system, determine coordinates of a bounding space proximate to the user wearing the AR-glasses, display one or more virtual objects to the wearer of the AR glasses via the AR glasses if and only if coordinates of the virtual objects are within the bounding space, and continuously update the coordinates of the three-dimensional bounding space and the virtual objects displayed therein as a function of the up-to-date spatial position of the user wearing the AR glasses.