G06F3/0646

SEGMENTING AND MERGING DATA IN A DISPERSED STORAGE NETWORK

A method for execution by a dispersed storage and task (DST) processing unit includes determining a first optimal slice size requirement is determined for a first independent data element (IDE). The first IDE is split into a first plurality of IDEs based on determining the first IDE compares unfavorably to the first optimal slice size requirement. An error coding function is performed on the first plurality of IDEs to produce a set of encoded slices for each of the first plurality of IDEs for transmission to storage units. A subset of additional IDEs are selected to be merged into a merged IDE based on a second optimal slice size requirement, and continuous content of the subset of additional IDEs is concatenated to produce the merged IDE. The error coding function is performed on the merged IDE to produce a second set of encoded slices for transmission to storage units.

SEGMENTING AND MERGING DATA IN A DISPERSED STORAGE NETWORK

A method for execution by a dispersed storage and task (DST) processing unit includes determining a first optimal slice size requirement is determined for a first independent data element (IDE). The first IDE is split into a first plurality of IDEs based on determining the first IDE compares unfavorably to the first optimal slice size requirement. An error coding function is performed on the first plurality of IDEs to produce a set of encoded slices for each of the first plurality of IDEs for transmission to storage units. A subset of additional IDEs are selected to be merged into a merged IDE based on a second optimal slice size requirement, and continuous content of the subset of additional IDEs is concatenated to produce the merged IDE. The error coding function is performed on the merged IDE to produce a second set of encoded slices for transmission to storage units.

Predictive data orchestration in multi-tier memory systems

A computing system having memory components of different tiers. The computing system further includes a controller, operatively coupled between a processing device and the memory components, to: receive from the processing device first data access requests that cause first data movements across the tiers in the memory components; service the first data access requests after the first data movements; predict, by applying data usage information received from the processing device in a prediction model trained via machine learning, second data movements across the tiers in the memory components; and perform the second data movements before receiving second data access requests, where the second data movements reduce third data movements across the tiers caused by the second data access requests.

Cache maintenance operations in a data processing system

An interconnect system and method of operating the system are disclosed. A master device has access to a cache and a slave device has an associated data storage device for long-term storage of data items. The master device can initiate a cache maintenance operation in the interconnect system with respect to a data item temporarily stored in the cache causing action to be taken by the slave device with respect to storage of the data item in the data storage device. For long latency operations the master device can issue a separated cache maintenance request specifying the data item and the slave device. In response an intermediate device signals an acknowledgment response indicating that it has taken on responsibility for completion of the cache maintenance operation and issues the separated cache maintenance request to the slave device. The slave device signals the acknowledgement response to the intermediate device and on completion of the cache maintenance operation with respect to the data item stored in the data storage device signals a completion response to the master device.

DATA TRANSFORMATION CACHING IN AN ARTIFICIAL INTELLIGENCE INFRASTRUCTURE
20200293378 · 2020-09-17 ·

Data transformation caching in an artificial intelligence infrastructure that includes one or more storage systems and one or more graphical processing unit (GPU) servers, including: identifying, in dependence upon one or more machine learning models to be executed on the GPU servers, one or more transformations to apply to a dataset; generating, in dependence upon the one or more transformations, a transformed dataset; storing, within one or more of the storage systems, the transformed dataset; receiving a plurality of requests to transmit the transformed dataset to one or more of the GPU servers; and responsive to each request, transmitting, from the one or more storage systems to the one or more GPU servers without re-performing the one or more transformations on the dataset, the transformed dataset.

TRANSFERRING DATA BETWEEN SOLID STATE DRIVES (SSDs) VIA A CONNECTION BETWEEN THE SSDs
20200293483 · 2020-09-17 ·

A first solid state drive (SSD) includes a first built-in network interface device configured to communicate via a network fabric, and a second SSD includes a second built-in network interface device configured to communicate via the network fabric. A connection is opened between the first SSD and the second SSD over the network fabric. Based on a non-volatile memory over fabric (NVMe-oF) communication protocol, an NVMe command to transfer data between the first SSD and the second SSD over the connection is encapsulated in a capsule. The capsule is sent from the first SSD to the second SSD over the connection via the network fabric. The second SSD executes the NVMe command in the capsule to transfer the data between the first SSD and the second SSD over the connection.

COMPUTER-READABLE RECORDING MEDIUM STORING TRANSFER PROGRAM, TRANSFER METHOD, AND TRANSFERRING DEVICE
20200293373 · 2020-09-17 · ·

A transfer method is performed by an information processing apparatus. The method includes: selecting, based on a load status of the information processing apparatus, candidate transfer data that is among the received data and to be transferred to one or more other information processing apparatuses; selecting, based on load statuses of multiple other information processing apparatuses, one or more candidate transfer destination apparatuses among the multiple other information processing apparatuses as candidate transfer destinations of the data; determining, based on throughput between the information processing apparatus and the candidate transfer destination apparatuses, data to be transferred among the candidate transfer data, transfer destination apparatuses of the data to be transferred among the candidate transfer destination apparatuses, and the sizes of data groups including the data to be transferred; and transferring, to the transfer destination apparatuses determined for the determined data groups, the determined data to be transferred.

FIRMWARE UPGRADE METHOD IN MULTIPLE NODE STORAGE SYSTEM
20200285455 · 2020-09-10 ·

A multiple storage node system including a first and second node is provided. The first node includes a first baseboard management controller (BMC), a first flash ROM configured to store a first flash image, and a first switch device configured to connect the first BMC to the first flash ROM. The second node includes an exact configuration of the first node. The first BMC is connected to the second switch device, and the second flash image is the same as the first flash.

Information processing apparatus and control method of information processing apparatus
10768846 · 2020-09-08 · ·

An information processing apparatus includes: a controller that controls a plurality of storage devices and transmits and receives data to and from the plurality of storage devices; and a bridge that communicates with the controller via a predetermined interface, communicates with each of the plurality of storage devices via each of a plurality of predetermined interfaces, and bridges the communications between the controller and the plurality of storage devices. The controller acquires information of a master boot record from each of the plurality of storage devices, and generates information of a master boot record in a virtual storage device to provide the plurality of storage devices as one storage device. The bridge controls a process for writing the information of the master boot record in the virtual storage device into a region of a master boot record in a first storage device out of the plurality of storage devices.

Storage device and data output method for storage device
10768845 · 2020-09-08 · ·

A storage device includes a storage retaining content data, an input receiving instructions to reproduce the content data stored in the storage and a reproducer outputting the content data to an external reproducing device. The storage retains a table including identification information of the external reproducing device and a data format of the content data reproducible in the external reproducing device. The reproducer includes a notifier notifying reproduction information necessary for the external reproducing device to reproduce the content data before the content data are outputted to the external reproducing device in response to a reproduction instruction, and a data controller acquiring unique identification information for the external reproducing device when the external reproducing device is connected to the storage device and converting the content data into the data format reproducible in the external reproducing device and outputting the content data thereto.