G06F3/0638

STORAGE MEDIUM MANAGEMENT METHOD AND APPARATUS, DEVICE, AND COMPUTER-READABLE STORAGE MEDIUM

In a storage medium management method, a controller receives an address space request that requests the provision of an address space in a target storage medium for an operating system, the target storage medium having two different types of storage media. The Controller determines a first address space in the target storage medium based on the address space request, and a physical address of the first address space to a target virtual address, which is managed by the operating system. The controller then provides to an operating system a first address space requested by the address space request, such that the first address space is directly managed by an operating system, without manual configuration or restart of an electronic device.

Processing device configured for efficient generation of compression estimates for datasets
11609883 · 2023-03-21 · ·

An apparatus in one embodiment comprises at least one processing device comprising a processor coupled to a memory. The processing device is configured to identify a dataset to be scanned to generate a compression estimate for that dataset, to designate a scan criterion to be utilized in the scan, and for each of a plurality of pages of the dataset, to scan the page, where scanning the page includes performing a computation on the page to obtain a page result, determining whether or not the page result satisfies the designated scan criterion, and responsive to the page result satisfying the designated scan criterion, updating a corresponding entry of a compression estimate table for the dataset. The processing device generates the compression estimate for the dataset based at least in part on contents of the compression estimate table. The scan criterion may comprise, for example, a designated content-based signature prefix, or a designated subset inclusion characteristic defining a polynomial-based signature subspace.

METHOD, ELECTRONIC DEVICE, AND COMPUTER PROGRAM PRODUCT FOR DATA COMPRESSION
20220342554 · 2022-10-27 ·

Embodiments of the present disclosure provide a method, an electronic device, and a computer program product for data compression. The method includes: comparing the size of a first data packet to be compressed with a first threshold size; if the size of the first data packet is greater than the first threshold size, determining at least two second data packets from the first data packet, wherein the size of each second data packet is less than a second threshold size; and respectively compressing the at least two second data packets. In this way, the delay of data compression can be shortened.

Distributed data store with persistent memory
11611617 · 2023-03-21 · ·

A method to build a persistent memory (PM)-based data storage system without involving a processor (CPU) at storage nodes is disclosed which includes storing data in one or more storage nodes that only include PM and no CPUs, with data stored in PM in form of link lists, accessing data stored in the one or more storage nodes' PM directly by remote compute nodes through a network, maintaining metadata associated with the data by one or more global controllers (metadata servers), upon request by a user to read or write data, the compute nodes contacting the one or more metadata servers to obtain location of data of interest in form of pointers (shortcuts), and the compute nodes sending network requests directly to the one or more storage nodes' PM to locate latest version of data by tracing the link list from the associated shortcut to corresponding tails.

Data processing system and data processing method

A data processing method includes the following steps: generating a machine-learning parameter and obtaining a storage parameter code, wherein the storage parameter code corresponds to a storage space; receiving the machine-learning parameter and the storage parameter code, and storing the machine-learning parameter in the storage space according to the storage parameter code, and generating an event notification when the machine-learning parameter is modified; and generating a loading request according to the event notification, and the loading request is used to request the modified machine-learning parameter, wherein after the loading request is generated, the modified machine-learning parameter is downloaded from the storage space corresponding to the storage parameter code.

System and Method for Non-Disruptive Upgrade for Metadata Log with Minimal Hiccup
20220342855 · 2022-10-27 ·

A method, computer program product, and computer system for controlling, by a computing device, access to a non-volatile memory using a non-volatile lock as a reader of the non-volatile memory. Metadata (MD) non-volatile memory commits may be throttled until capacity of the non-volatile memory is at a threshold capacity.

ADAPTIVE COMPRESSION OF STORED DATA

Systems, devices and methods for adaptive compression of stored information includes a memory management computing device programmed to monitor a size of a plurality of data structures stored in a data repository. The computing device compares the size of each of a plurality of data structures to a predetermined threshold. When a size of an uncompressed data structure meets the threshold, the memory management computing device calculates a value of a first compression parameter based on a value of a first parameter and a value of a second parameter of each data element of the uncompressed data structure, calculates a value of a second compression parameter based the value of the first parameter of each data element of the uncompressed data structure, generates a compressed data structure based on the value of the first compression parameter and the second compression parameter; and replaces, in the data repository, the uncompressed data structure with the compressed data structure.

Enabling compression based on queue occupancy

Various embodiments are provided for enabling data compression in a computing system by a processor. Each storage block of a storage device associated with a queue may be split. Compression of data may be activated upon data occupancy within a queue exceeding a dynamic threshold. In one aspect, only a partial amount of the data is fetched, back to back, from a divided storage block in the storage block according to the queue based upon the data occupancy within the queue exceeding the dynamic threshold. A complete amount of the data may be fetched from the divided storage block in a storage block according to the queue upon the data occupancy within the queue being less than dynamic threshold.

Methods for using extended physical region page lists to improve performance for solid-state drives and devices thereof
11481335 · 2022-10-25 · ·

Methods, non-transitory machine readable media, and computing devices that use extended physical region page (PRP) lists to improve storage device performance are disclosed. With this technology, a PRP list is generated that includes pointers retrieved from a scatter/gather list (SGL) for memory buffers representing data segments associated with a storage operation. The PRP list is extended to include a pointer to an allocated memory page configured to store metadata segments represented by other memory buffers referenced by other pointers in the SGL. A command request that includes the extended PRP list is submitted to a storage device for execution of the storage operation. With this technology, storage operations are advantageously enabled for non-volatile memory express (NVMe) solid-state drive (SSDs), for example, that do not support SGL transfers.

ENSURING SUFFICIENT SPACE IS AVAILABLE ON TARGET VOLUMES BEFORE PERFORMING A POINT-IN-TIME COPY JOB

A computer-implemented method according to one embodiment includes, prior to executing a point-in-time copy job, running a space checker program to generate a list that includes: source data sets that will be used in the point-in-time copy job and a pool of potential target volumes that are eligible to be used for the point-in-time copy job. The method further includes determining that insufficient space is available on the potential target volumes to perform the point-in-time copy job. An on-demand migration is issued against one or more target volumes of the pool of potential target volumes for ensuring there is sufficient space available on the one or more target volumes associated with the issued on-demand migration to perform the point-in-time copy job. The method further includes performing the point-in-time copy job.