A data collection system that performs data collection of human-driven robot actions for robot learning. The data collection system includes: i) a wearable computation subsystem that is worn by a human data collector and that controls the data collection process and ii) a human-machine operation interface subsystem that allows the human data collector to use the human-machine operation interface to operate an attached robotic gripper to perform one or more actions. A user interface subsystem receives instructions from the wearable computation subsystem that direct the human data collector to perform the one or more actions using the human-machine operation interface subsystem. A visual sensing subsystem includes one or more cameras that collect raw visual data related to the pose and movement of the robotic gripper while performing the one or more actions. A data collection subsystem receives collected data related to the one or more actions.

An electronic apparatus for a database construction and control of a robotic manipulator is provided. The electronic apparatus stores information associated with a task of a robotic manipulator. The electronic apparatus further receives a first plurality of signals from a first plurality of sensors associated with a wearable device. The electronic apparatus further applies a predefined model on a first set of signals of the first plurality of signals. The electronic apparatus further determines arrow direction information based on the application of the predefined model on the first set of signals. The electronic apparatus further aggregates the determined arrow direction information with information about the first set of signals to generate output information. The electronic apparatus further stores the generated output information for each of a first plurality of poses performed for the task using the wearable device.

A wearable device for assisting a human body movement according to an embodiment of the present disclosure includes a sensor including an inner electrode arranged at a center of an arbitrary circle, a plurality of outer electrodes arranged at regular intervals in a circumferential direction at positions spaced apart from the inner electrode in a radial direction so as to be arranged on a circumference of the circle, and a plurality of deformation elements disposed between the inner electrode and each of the outer electrodes and formed of a material whose resistance is changed by deformation; a controller configured to apply different control signals to an actuator according to a combination of different resistance values of the deformation elements of the sensor; and the actuator operating based on the control signals of the controller.

A method and apparatus includes a monitor in communication with, e.g., a work glove with built-in sensors to track an operator's physical activities including intermittently using hand tools, hand motion, and position or location in a work area. The sensors provide time-series data representative of the activities, and the monitor classifies and sequences the activities based on the time-series data along with, optionally, machine tool operational data. The classified and sequenced activities may then compared to instructed work procedures, ensuring correct work materials are used in production, and ensuring an operator's safety by detecting unsafe or abnormal work conditions.

A sleeve worn on an arm allows detection of gestures by an array of sensors. Electromyography, inertial, and magnetic field sensors provide data that is processed to categorize gestures and translate the gestures into commands for robotic systems. Machine learning allows training of gestures to increase accuracy of detection for different users.

An electronic apparatus for a database construction and control of a robotic manipulator is provided. The electronic apparatus stores information associated with a task of a robotic manipulator. The electronic apparatus further receives a first plurality of signals from a first plurality of sensors associated with a wearable device. The electronic apparatus further applies a predefined model on a first set of signals of the first plurality of signals. The electronic apparatus further determines arrow direction information based on the application of the predefined model on the first set of signals. The electronic apparatus further aggregates the determined arrow direction information with information about the first set of signals to generate output information. The electronic apparatus further stores the generated output information for each of a first plurality of poses performed for the task using the wearable device.

A wearable device for assisting a human body movement according to an embodiment of the present disclosure includes a sensor including an inner electrode arranged at a center of an arbitrary circle, a plurality of outer electrodes arranged at regular intervals in a circumferential direction at positions spaced apart from the inner electrode in a radial direction so as to be arranged on a circumference of the circle, and a plurality of deformation elements disposed between the inner electrode and each of the outer electrodes and formed of a material whose resistance is changed by deformation; a controller configured to apply different control signals to an actuator according to a combination of different resistance values of the deformation elements of the sensor; and the actuator operating based on the control signals of the controller.

A data collection system that performs data collection of human-driven robot actions for robot learning. The data collection system includes: i) a wearable computation subsystem that is worn by a human data collector and that controls the data collection process and ii) a human-machine operation interface subsystem that allows the human data collector to use the human-machine operation interface to operate an attached robotic gripper to perform one or more actions. A user interface subsystem receives instructions from the wearable computation subsystem that direct the human data collector to perform the one or more actions using the human-machine operation interface subsystem. A visual sensing subsystem includes one or more cameras that collect raw visual data related to the pose and movement of the robotic gripper while performing the one or more actions. A data collection subsystem receives collected data related to the one or more actions.

A sleeve worn on an arm allows detection of gestures by an array of sensors. Electromyography, inertial, and magnetic field sensors provide data that is processed to categorize gestures and translate the gestures into commands for robotic systems. Machine learning allows training of gestures to increase accuracy of detection for different users.

A method for training and/or testing a robot control module. The method includes generating an instruction specified by a robot control module configured for robot training and/or testing, the instruction indicating how a human-driven robot task is to be performed when training and/or testing the robot control module; providing the instruction to a mixed reality device worn by a human data collector, the mixed device rendering the instruction in a manner that shows the human data collector how to perform the human-driven robot task; collecting performance data and environmental data in response to the human data collector attempting to perform the human-driven robot task using the data collection device; receiving feedback data in response to the human data collector attempting to perform the human-driven robot task specified by the instruction; and updating the robot control module using the feedback data and the collected performance and environmental data.