The systems and methods provide an action recognition and analytics tool for use in manufacturing, health care services, shipping, retailing, restaurants and other similar contexts. Machine learning action recognition can be utilized to determine cycles, processes, actions, sequences, objects and or the like in one or more sensor streams. The sensor streams can include, but are not limited to, one or more video sensor frames, thermal sensor frames, infrared sensor frames, and or three-dimensional depth frames. The analytics tool can provide for establishing traceability.

The systems and methods provide an action recognition and analytics tool for use in manufacturing, health care services, shipping, retailing and other similar contexts. Machine learning action recognition can be utilized to determine cycles, processes, actions, sequences, objects and or the like in one or more sensor streams. The sensor streams can include, but are not limited to, one or more video sensor frames, thermal sensor frames, infrared sensor frames, and or three-dimensional depth frames. The analytics tool can provide for process validation, anomaly detection and in-process quality assurance.

Workspace coordination systems and methods are presented. A method can comprise: accessing in real time respective information associated with a first actor and a second actor, including sensed activity information; analyzing the information, including analyzing activity of the first actor with respect to a second actor; and forwarding respective feedback based on the results of the analysis. The feedback can includes an individual objective specific to one of either the first actor or the second actor. The feedback includes collective objective with respect to the first actor or the second actor. The analyzing can include automated artificial intelligence analysis. Sensed activity information can be associated with a grid within the activity space. It is appreciated there can be various combinations of actors (e.g., human and device, device and device, human and human, etc.). The feedback can be a configuration layout suggestion. The feedback can be a suggested assignment of a type of actor to an activity.

The systems and methods provide an action recognition and analytics tool for use in manufacturing, health care services, shipping, retailing and other similar contexts. Machine learning action recognition can be utilized to determine cycles, processes, actions, sequences, objects and or the like in one or more sensor streams. The sensor streams can include, but are not limited to, one or more video sensor frames, thermal sensor frames, infrared sensor frames, and or three-dimensional depth frames. The analytics tool can provide for automatic creation of work charts.

Embodiments of the present invention provide a machine and continuous data set including process data, quality data, specific actor data, and ergonomic data (among others) to create more accurate job assignments that maximize efficiency, quality and worker safety. Using the data set, tasks may be assigned to actors based on objective statistical data such as skills, task requirements, ergonomics and time availability. Assigning tasks in this way can provide unique value for manufacturers who currently conduct similar analyses using only minimal observational data.

The systems and methods provide an action recognition and analytics tool for use in manufacturing, health care services, shipping, retailing and other similar contexts. Machine learning action recognition can be utilized to determine cycles, processes, actions, sequences, objects and or the like in one or more senor streams. The sensor streams can include, but are not limited to, one or more video sensor frames, thermal sensor frames, infrared sensor frames, and or three-dimensional depth frames. The analytics tool can provide for contextual training using the one or more sensor streams and machine learning based action recognition.

An example method includes receiving position data indicative of position of a demonstration tool. Based on the received position data, the method further includes determining a motion path of the demonstration tool, wherein the motion path comprises a sequence of positions of the demonstration tool. The method additionally includes determining a replication control path for a robotic device, where the replication control path includes one or more robot movements that cause the robotic device to move a robot tool through a motion path that corresponds to the motion path of the demonstration tool. The method also includes providing for display of a visual simulation of the one or more robot movements within the replication control path.

The invention relates to a method for controlling an automation assembly which has a robot assembly with at least one robot (10) and a detection means assembly with at least one detection means (21-23), said method having the following at least partly automated steps: providing (S10) a first sequence of first ordinate data (q.sub.1, q.sub.2, dq.sub.2/dt, .sub.1, .sub.2) assigned to successive first abscissa points (t) on the basis of first training data (q.sub.1, q.sub.2, .sub.1, x.sub.2); identifying (S20) a first event point (t.sub.E) within the first abscissa points of the first sequence; and determining (S30) a first event criterion on the basis of the first sequence and the first event point.

A method of deriving autonomous control information involves receiving one or more sets of associated environment sensor information and device control instructions. Each set of associated environment sensor information and device control instructions includes environment sensor information representing an environment associated with an operator controllable device and associated device control instructions configured to cause the operator controllable device to simulate at least one action taken by at least one operator experiencing a representation of the environment generated from the environment sensor information. The method also involves deriving autonomous control information from the one or more sets of associated environment sensor information and device control instructions, the autonomous control information configured to facilitate generating autonomous device control signals from autonomous environment sensor information representing an environment associated with an autonomous device, the autonomous device control signals configured to cause the autonomous device to take at least one autonomous action.

A system for guiding and evaluating physical positioning, orientation and motion of the human body, comprising: a cloud computing-based subsystem including an artificial neural network and spatial position analyzer said cloud computing-based subsystem adapted for data storage, management and analysis; at least one motion sensing device wearable on the human body, said at least one motion sensing device adapted to detect changes in at least one of spatial position, orientation, and rate of motion; a mobile subsystem running an application program (app) that controls said at least one motion sensing device, said mobile subsystem adapted to capture activity data quantifying said changes in at least one of spatial position, orientation, and rate of motion, said mobile subsystem further adapted to transfer said activity data to said cloud computing-based subsystem, wherein said cloud computing-based subsystem processes, stores, and analyzes said activity data.