An apparatus and method for providing an immutable audit trail for machine learning applications is described herein. The audit trail is preserved by recording the machine learning models and data in a data structure in immutable storage such as a WORM device, or in a blockchain. The immutable audit trail is important for providing bank auditors with the reasons for lending or account opening reasons, for example. A graphical user interface is described to allow the archive of machine learning models to be viewed.

One embodiment provides a method, including: receiving, at a central system, a query requesting access to a dataset, wherein the central system communicates with a plurality of data storage locations, each having a governance policy for data stored at the data storage location, wherein different portions of the dataset are stored within different of the plurality of data storage locations; sending a sub-query formulated based upon the query; receiving a governance enforcement actions listing corresponding to the portion of the dataset stored within the corresponding data storage location; generating a meta-policy of enforcement actions for all of the plurality of data storage locations storing portions of the dataset, wherein the meta-policy identifies enforcement actions and an order of the enforcement actions to be applied to the dataset; and providing the meta-policy to each of the plurality of data storage locations.

A solid state drive having a drive aggregator and a plurality of component solid state drive, including a first component solid state drive and a second component solid state drive. The drive aggregator has at least one host interface, and a plurality of drive interfaces connected to the plurality of component solid state drives. The drive aggregator is configured to generate, in the second solid state drive, a copy of a dataset that is stored in the first component solid state drive. In response to a failure of the first component solid state drive, the drive aggregator is configured to substitute a function of the first component solid state drive with respect to the dataset with a corresponding function of the second component solid state drive, based on the copy of the dataset generated in the second component solid state drive.

Techniques for persistent crash logging. The techniques may include making, by a monitor, a first determination that an event information file exists in a volatile storage device location in a volatile storage device. The first determination may be made after an agent event occurs. The techniques may also include performing, by the monitor, an action on a portion of the event information file to obtain a uniquely identifiable filename portion and writing, by the monitor, an event information file copy to a non-volatile storage location in a non-volatile storage device. The techniques may also include, after writing the event information file copy to the non-volatile storage location is complete, renaming, by the monitor, the event information file copy to a uniquely identifiable filename comprising the uniquely identifiable filename portion.

A method, computer program product, and computing system for determining whether storage space usage on a storage system has reached a predefined threshold of a total storage capacity of the storage system. An out-of-space mode may be initiated on the storage system in response to determining that the storage space usage has reached the predefined threshold of the total storage capacity of the storage system. An amount of free storage capacity for exiting the out-of-space mode may be determined based upon, at least in part, a predefined minimum free storage capacity, a predefined maximum free storage capacity, and the total storage capacity of the storage system.

Data resiliency in a cloud-based storage system, including: receiving, for storage within a first tier of cloud storage of the cloud-based storage system, one or more segments of data; generating, for each of one or more shards of data of the one or more segments of data, self-describing information for recoverability of the one or more shards of data; and storing, within a second tier of cloud storage of the cloud-based storage system, both the one or more shards of data and the generated self-describing information for recoverability of the one or more shards of data.

A memory system comprises a nonvolatile memory including a plurality of blocks, a memory controller capable of controlling the nonvolatile memory, and a tag information management table in which tag information allocated to an address of data written to a block of nonvolatile memory, is stored, wherein the tag information is representative of the number of erasures of the block. The memory controller performs garbage collection of the nonvolatile memory based on the tag information.

A method, system, and computer-readable medium is described for facilitating interactions between software programs by providing a reliable data queuing service that enables the programs to store and retrieve elements of data queues. In some situations, the data queuing service is provided to users who purchase usage of the data queuing service for application programs executed by or otherwise affiliated with the users. In addition, accessibility of the data queuing service to remote executing programs may be enhanced via a defined API of the data queuing service, such as a Web services-based API. Availability of the data queuing service may also be enhanced in some situations by using multiple alternative distributed systems for a data queue such that each of the alternative systems stores a subset of the elements of the data queue.

Techniques for managing a disk involve acquiring a message for an access operation for a disk, the message including a first status code at an operating system level for the access operation. The techniques further involve acquiring a second status code at a disk hardware level for the access operation if it is determined that the first status code indicates that the access operation fails. The techniques further involve determining, according to a handling policy corresponding to the second status code, whether the disk will be marked as faulty. The techniques further involve managing the disk based on a count of failed access operations for the disk if it is determined that the disk is not marked as faulty. Such techniques may quickly determine a specific reason for a failure of a disk access operation, making it possible to solve problems quickly, save time and improve the user experience.

A feature can be defined to allow data attributes to be dynamically assigned to data in a storage device. For example, a feature referred to as a “datagroup” is introduced. A datagroup is defined as a grouping of a range of local block addresses. A storage device can be divided into a number of datagroups. Each datagroup can have its own data attributes configuration, which can have a specified number of bits. A new command is defined to allow a host to dynamically assign attributes of datagroups of a storage device. For example, the command can provide for dynamically assigning datagroup attributes by sending a byte-mapping table in the command from the host to the storage device.