A distributed processing method based on a consistency protocol is provided. The method includes: transmitting a decree prepare request including a first decree number, the decree prepare request requesting other nodes to promise to no longer accept a fast write operation initiated by a leader node whose leader number is less than the first decree number, the first decree number representing a leader number of a current node, and the leader number representing a number of a decree at which the current node that becomes a leader node is located; and in response to receiving decree promises from at least a preset quantity of nodes among the other nodes, enabling the fast write operation from a subsequent decree number of a second decree number determined based on the decree promises, each of the decree promises including the first decree number.

In an approach for generating differentiated workload telemetry data, a processor corresponds one or more services with a workload related telemetry generating an event emitter. A processor performs a correlation analysis of corresponding relationship and connection among connected resources and current traffic into and out of the one or more services. A processor labels domain context for each telemetry event. A processor communicates each telemetry event to a global event handler. A processor performs a cross-correlation in real-time of telemetry data with the global event handler. A processor updates a real-time differentiated workload report.

Techniques are used for balancing load on a storage system according to multiple variables. The techniques may be used to provide, among other things, defining, across at least two variables, a balance constraint for a load on a storage system. Among a set of transfers of volumes from one node to another node in the storage system, a transfer of a volume that minimizes the distance between the load and an ideal balanced state of the storage system is identified. The identified transfer of a volume is added to a combination of transfers of volumes. Whether the combination of transfers of volumes meets the balance constraint is determined. If the combination meets the balance constraint, the combination is selected as a solution to balance the load.

A method begins by a load balancing module of a distributed storage network (DSN) determining availability of a plurality of DSN processing units of a set of DSN processing units based on availability information associated with the plurality of DSN processing units and in response to determined availability, selecting a DSN processing unit form the set to process a data access request. The method continues with the load balancing module receiving an indication that the DSN processing unit is no longer available from the DSN processing unit while the DSN processing unit continues to process previously pending data access requests. The method continues with the load balancing module cancelling selection of the DSN processing unit to process the data access request; and receiving a second indication from the DSN processing unit indication that the DSN processing unit is available.

A method for managing data storage using a distributed file system. A file system volume associated with a write request received at a data management subsystem is identified. A logical block device associated with the file system volume is identified. A plurality of data blocks is formed based on the write request. The plurality of data blocks is distributed across a plurality of node block stores in a distributed block layer of a storage management subsystem of the distributed file system. Each of the plurality of node block stores corresponds to a different node of a plurality of nodes in the distributed storage system. The storage management subsystem operates separately from but in communication with the data management subsystem.

A system is disclosed. A storage device may store a data. A load module may read the data from the storage device based at least in part on an input/output (I/O) request. A scheduler may place the I/O request in a queue for delivery to the load module based at least in part on a size of the I/O request being less than a threshold.

Adaptive storage processing for storage-as-a-service, including detecting, by a cloud-based monitoring system, a storage system state for a storage system by monitoring the storage system in real-time remotely via a network; selecting, by the cloud-based monitoring system based on the storage system state, an entry in a tunables repository, wherein the entry in the tunables repository comprises a tunable parameter for the storage system state; accessing, by the cloud-based monitoring system via the network, a gateway for the storage system; and modifying, by the cloud-based monitoring system via the gateway, the tunable on the storage system based on the tunable parameter for the storage system state.

Adaptive storage processing for storage-as-a-service, including detecting, by a cloud-based monitoring system, a storage system state for a storage system by monitoring the storage system in real-time remotely via a network; selecting, by the cloud-based monitoring system based on the storage system state, an entry in a tunables repository, wherein the entry in the tunables repository comprises a tunable parameter for the storage system state; accessing, by the cloud-based monitoring system via the network, a gateway for the storage system; and modifying, by the cloud-based monitoring system via the gateway, the tunable on the storage system based on the tunable parameter for the storage system state.

Techniques are used for balancing load on a storage system according to multiple variables. The techniques may be used to provide, among other things, defining, across at least two variables, a balance constraint for a load on a storage system. Among a set of transfers of volumes from one node to another node in the storage system, a transfer of a volume that minimizes the distance between the load and an ideal balanced state of the storage system is identified. The identified transfer of a volume is added to a combination of transfers of volumes. Whether the combination of transfers of volumes meets the balance constraint is determined. If the combination meets the balance constraint, the combination is selected as a solution to balance the load.

An apparatus comprises a processing device configured to determine a workload level of each storage resource in a set of two or more storage resources, the workload levels being based at least in part on a processor performance metric, a memory performance metric, and a load performance metric. The processing device is also configured to identify a performance imbalance rate for the set of two or more storage resources, and to perform workload balancing for the set of two or more storage resources responsive to (i) the performance imbalance rate for the set of two or more storage resources exceeding a designated imbalance rate threshold and (ii) at least one storage resource in the set of two or more storage resources having a workload level exceeding a designated threshold workload level.