A data processing system for controlling an industrial process includes a cross software platform layer including a data acquisition (DA) add-in and calculation add-in coupled to receive measured field data from a field layer including a process data link or Communication Interface Unit (CIU) coupled to processing equipment in the plant having associated field devices including sensors for providing measured field data and actuators configured to run the industrial process. A processor implements a DA algorithm to provide the DA add-in, a calculation algorithm to provide the calculation add-in, and a visualization algorithm all stored in a memory associated with the processor. The DA add-in acquires the measured field data from the field devices, the calculation add-in generates calculated data from the measured field data, and an application layer is for applying the visualization algorithm to the calculated data to populate cells of a spreadsheet.

A scalable industrial data ingestion and analysis architecture integrates and collects data from multiple diverse sources at one or more industrial facilities. Data sources can include plant-level industrial devices and higher-level business systems. The data can be integrated and collected from multiple sources at an on-premise edge or gateway device, which sends the data to event queues on the cloud platform. The data queues orchestrate and store the data on cloud storage, and an analytics layer performs business analytics or other types of analysis on the stored data to produce various outcomes. Similar analytic platforms can also be implemented at the device level, and analytic functions can be scaled between the device level and higher levels in accordance with the scope of a given analytic function.

A scalable industrial data ingestion and analysis architecture integrates and collects data from multiple diverse sources at one or more industrial facilities. Data sources can include plant-level industrial devices and higher-level business systems. The data can be integrated and collected from multiple sources at an on-premise edge or gateway device, which sends the data to event queues on the cloud platform. The data queues orchestrate and store the data on cloud storage, and an analytics layer performs business analytics or other types of analysis on the stored data to produce various outcomes. Similar analytic platforms can also be implemented at the device level, and analytic functions can be scaled between the device level and higher levels in accordance with the scope of a given analytic function.

A scalable industrial data ingestion and analysis architecture integrates and collects data from multiple diverse sources at one or more industrial facilities. Data sources can include plant-level industrial devices and higher-level business systems. The data can be integrated and collected from multiple sources at an on-premise edge or gateway device, which sends the data to event queues on the cloud platform. The data queues orchestrate and store the data on cloud storage, and an analytics layer performs business analytics or other types of analysis on the stored data to produce various outcomes. Similar analytic platforms can also be implemented at the device level, and analytic functions can be scaled between the device level and higher levels in accordance with the scope of a given analytic function.

A system for assigning a workload to compute resources includes an interface and a processor. The interface is configured to receive a workload. The processor is configured to break the workload into a set of subproblems; and for a subproblem of the set of subproblems: determine whether the subproblem benefits from intersheet parallelism; determine whether the subproblem benefits from intrasheet parallelism; determine whether the subproblem benefits from directed acyclic graph (DAG) partitioning; and assign the subproblem, wherein assigning the subproblem utilizes optimization when appropriate based at least in part on benefits from the intersheet parallelism, the intrasheet parallelism, and the DAG partitioning.

A scalable industrial data ingestion and analysis architecture integrates and collects data from multiple diverse sources at one or more industrial facilities. Data sources can include plant-level industrial devices and higher-level business systems. The data can be integrated and collected from multiple sources at an on-premise edge or gateway device, which sends the data to event queues on the cloud platform. The data queues orchestrate and store the data on cloud storage, and an analytics layer performs business analytics or other types of analysis on the stored data to produce various outcomes. Similar analytic platforms can also be implemented at the device level, and analytic functions can be scaled between the device level and higher levels in accordance with the scope of a given analytic function.

A scalable industrial data ingestion and analysis architecture integrates and collects data from multiple diverse sources at one or more industrial facilities. Data sources can include plant-level industrial devices and higher-level business systems. The data can be integrated and collected from multiple sources at an on-premise edge or gateway device, which sends the data to event queues on the cloud platform. The data queues orchestrate and store the data on cloud storage, and an analytics layer performs business analytics or other types of analysis on the stored data to produce various outcomes. Similar analytic platforms can also be implemented at the device level, and analytic functions can be scaled between the device level and higher levels in accordance with the scope of a given analytic function.

A scalable industrial data ingestion and analysis architecture integrates and collects data from multiple diverse sources at one or more industrial facilities. Data sources can include plant-level industrial devices and higher-level business systems. The data can be integrated and collected from multiple sources at an on-premise edge or gateway device, which sends the data to event queues on the cloud platform. The data queues orchestrate and store the data on cloud storage, and an analytics layer performs business analytics or other types of analysis on the stored data to produce various outcomes. Similar analytic platforms can also be implemented at the device level, and analytic functions can be scaled between the device level and higher levels in accordance with the scope of a given analytic function.

A scalable industrial data ingestion and analysis architecture integrates and collects data from multiple diverse sources at one or more industrial facilities. Data sources can include plant-level industrial devices and higher-level business systems. The data can be integrated and collected from multiple sources at an on-premise edge or gateway device, which sends the data to event queues on the cloud platform. The data queues orchestrate and store the data on cloud storage, and an analytics layer performs business analytics or other types of analysis on the stored data to produce various outcomes. Similar analytic platforms can also be implemented at the device level, and analytic functions can be scaled between the device level and higher levels in accordance with the scope of a given analytic function.

A data processing system for controlling an industrial process includes a cross software platform layer including a data acquisition (DA) add-in and calculation add-in coupled to receive measured field data from a field layer including a process data link or Communication Interface Unit (CIU) coupled to processing equipment in the plant having associated field devices including sensors for providing measured field data and actuators configured to run the industrial process. A processor implements a DA algorithm to provide the DA add-in, a calculation algorithm to provide the calculation add-in, and a visualization algorithm all stored in a memory associated with the processor. The DA add-in acquires the measured field data from the field devices, the calculation add-in generates calculated data from the measured field data, and an application layer is for applying the visualization algorithm to the calculated data to populate cells of a spreadsheet.