A robot system includes a robot, a robot controller, a video acquisition device configured to acquire a real video of a work space, and a head-mounted type video display device provided with a visual line tracking section configured to acquire visual line information. A robot controller includes an information storage section configured to store information used for controlling the robot while associating the information with a type of an object, a gaze target identification section configured to identify, in the video, a gaze target viewed by a wearer based on the visual line information, and a display processing section configured to cause the video display device to display the information associated with the object corresponding to the identified gaze target, side by side with the gaze target in the form of one image through which the wearer can visually grasp, select, or set contents of the information.

A service providing system including: a mobile robot configured to act in response to an instruction from a user through wireless communication and including a sensor having a capability corresponding to a human sensing capability to perceive an external world; a target identifying unit configured to identify whether an action target of the robot is a human being or another robot; an user apparatus control portion configured to output the signal detected by the sensor in a first manner when the action target is identified to be a human being and output the signal detected by the sensor in a second manner when the action target is identified to be the other robot; and a user apparatus configured to act in a manner perceivable by the user based on a output signal.

Various aspects of the disclosure relate to a virtual assistant factory that supports back office operations within a computing system. Various internal services (e.g., banking services, user management services, and the like) may be accessible to external application via an application programming interface. In some cases, a virtual assistant factory computing platform may expose services that call on and/or are tied to various back office computing operations. The virtual assistant factory platform may spin up and host robots, controls, and/or processes that may supplement computing operations and other associated back office operations. The application interface may call API functions that may cause the virtual assistant factory to spin up a virtual assistant to perform various functions and interact with both the user and the appropriate back office operations and/or third-party computing systems.

A control system is for a robot. In an embodiment, the control system includes a program executor to translate a motion command for a robot to a format identifiable by a robot control kernel; a robot control kernel to generate robot motion data based on the translated motion command; and a robot Digital Twin to simulate the motion of the robot based on the generated robot motion data and physical conditions of the robot during robot simulation.

A computer-based system and method is disclosed for spatial programming of a robotic device. A mixed reality tool may select an object related to one or more interactive tasks for the robotic device. A spatial location of the object may be located including Cartesian coordinates and orientation coordinates of the object. An application program may be executed to operate the robotic device using the spatial location. Based on initial parameters, execution of the one or more tasks by the robotic device on the object related to a skill set may be simulated in a mixed reality environment.

In some aspects, a system comprises a computer hardware processor and a non-transitory computer-readable storage medium storing processor-executable instructions for receiving, from one or more sensors, sensor data relating to a robot; generating, using a statistical model, based on the sensor data, first control information for the robot to accomplish a task; transmitting, to the robot, the first control information for execution of the task; and receiving, from the robot, a result of execution of the task.

A robot system and a method of controlling the robot system are provided. According to an embodiment, the robot system includes a robot, a server that stores information on a motion of the robot, and a terminal that communicates with the robot and the server, receives a motion of the robot from the robot, receives a stored character motion from the server, and displays a character motion corresponding to the robot as an image. The robot system may transmit and receive a wireless signal over a mobile communication network based on 5G communication technologies.

In some aspects, a system comprises a computer hardware processor and a non-transitory computer-readable storage medium storing processor-executable instructions for receiving, from one or more sensors, sensor data relating to a robot; generating, using a statistical model, based on the sensor data, first control information for the robot to accomplish a task; transmitting, to the robot, the first control information for execution of the task; and receiving, from the robot, a result of execution of the task.

A visualisation system for visualising the processing of a chemical product uses at least two processing units. The visualisation system contains a communication interface, a profiling module, and a user interface. The communication interface is configured for communicating with the processing units to receive a respective value of processing parameters for processing the chemical product. The profiling module is configured for providing a reference profile including a respective reference value for processing parameters for a reference chemical product and for providing a profile for the chemical product. The profile includes a respective deviation value of processing parameters for the chemical product determined based on a difference between the respective value of the processing parameters for processing the chemical product and the respective reference value. The user interface is configured for visualising information about processing the chemical product including the profile in a mixed reality view or a virtual reality view.

A display system for performing a predetermined operation with respect to a moving body is disclosed. The display system includes an operation reception unit configured to receive a switching operation to switch an operation mode between a manual operation mode and an autonomous movement mode, the manual operation mode being selected for moving the moving body by manual operation and the autonomous movement mode being selected for moving the moving body by autonomous movement; and a display controller configured to display notification information representing accuracy of the autonomous movement.