G06F2211/1035

REBUILD PRIORITIZATION DURING A PLURALITY OF CONCURRENT DATA OBJECT WRITE OPERATIONS

A method includes receiving data objects at substantially the same time for storage. The method further includes determining priority levels for the data objects. The method further includes establishing write thresholds for encoding the data objects based on the priority levels. The method further includes dispersed storage error encoding the data objects to produce pluralities of sets of encoded data slices. The method further includes executing write operations to store the pluralities of sets of encoded data slices in storage units in accordance with the write thresholds. During execution of the write operations, the method further includes identifying encoded data slices that were not properly stored and determining rebuild priorities for them. The method further includes rebuilding at least some of the encoded data slices based on the rebuild priorities.

PRIORITY BASED REBUILDING

A method includes determining, by a computing device of a dispersed storage network (DSN), a data priority level for a data object. The method further includes determining, by the computing device, slice priority levels based on the data priority level. The method further includes encoding, by the computing device, the data object into sets of encoded data slices. While writing the sets of encoded data slices to storage units, the method further includes detecting, by a rebuilding module of the DSN, a slice error for an encoded data slice. When the data priority level is below a data priority threshold and the slice has the first slice priority level, the method further includes facilitating rebuilding of the slice. When the data priority level is below the data priority threshold and the slice has the second slice priority level, the method further includes foregoing rebuilding of the slice.

IDENTIFYING STORED DATA SLICES DURING A SLICE MIGRATION ACTIVITY IN A DISPERSED STORAGE NETWORK
20170123717 · 2017-05-04 ·

A method for execution by a dispersed storage and task (DST) execution unit includes obtaining a list slice request. At least one other storage unit affiliated with a DSN address range of the list slice request is identified and at least one proxied list slice request is issued to the at least one other storage unit. At least one received proxied list slice response associated with the list slice request is selected, and a list slice response is issued to the requesting entity based on the at least one selected proxied list slice response and locally stored encoded data slices associated with the list slice request.

Acquiring multi-media content

A method begins by a dispersed storage (DS) processing module receiving a first sub-set of encoded data slices, wherein a data segment of multi-media content was encoded using a dispersed storage error coding function to produce a set of encoded data slices, wherein the set of encoded data slices is partitioned into the first sub-set of encoded data slices and a second sub-set of encoded data slices. The method continues with the DS processing module sending accessing information when the second sub-set of encoded data slices is to be requested. The method continues with the DS processing module receiving, in response to the accessing information, at least one of the encoded data slices of the second sub-set of encoded data slices such that a decode threshold number of encoded data slices have been received.

Intelligent data repair for moving source

Systems and methods for intelligently repairing data are disclosed. An example method is performed by one or more processors of a data quality management (DQM) system and includes receiving a transmission over a communications network from a computing device associated with the DQM system, the transmission including an indication that source data stored in a source database was ingested and stored as target data in a target database at a time of ingestion, comparing, using an advanced DQM algorithm, the target data with the source data, the advanced DQM algorithm including generating a first set of parity results based on changes occurring before the time of ingestion, generating a second set of parity results based on changes occurring after the time of ingestion, and generating differential results based on the first and the second set of parity results, and selectively repairing ones of the changes based on the differential results.

Transparent and lightweight recovery from hardware memory errors

Systems and methods are disclosed that allow for transparently recovering from an uncorrected multi-bit error of arbitrary length located at a memory address. Storing one or more parity pages, for a set of pages in system memory, such that a page in the set of pages may be reconstructed using one of the parity pages is disclosed. Storing an indication of one or more page'disk location such that the one or more pages may be reconstructed by refilling the page from disk is also disclosed.