High performance space efficient distributed storage is disclosed. For example, a distributed storage volume (DSV) is deployed on a plurality of hosts, with a first host storing a local cache, and a storage controller executing on a processor of the first host receives a request to store a first file. The first file is stored to the local cache. The DSV is queried to determine whether a second file that is a copy of the first file is stored in the DSV. In response to determining that the DSV lacks the second file, the first file is transferred from the local cache to the DSV and then replicated to a second host of the plurality of hosts. In response to determining that the second file resides in the DSV, a reference to the second file is stored in the DSV and then replicated to the second host.

A predictive method for scheduling of the operations is described. The predictive method utilizes data generated from computing an expected lifetime of the individual files or objects within the container. The expected lifetime of individual files or objects can be generated based on machine learning techniques. Operations such as garbage collection are scheduled at an epoch where computational efficiencies are realized for performing the operation.

An illustrative embodiment disclosed herein is an apparatus including a processor and a memory. In some embodiments, the memory includes programmed instructions that, when executed by the processor, cause the apparatus to store a first object and a second object in a first region based on the first object and the second object having a first policy. In some embodiments, the memory includes programmed instructions that, when executed by the processor, cause the apparatus to store a third object in a second region based on the third object having a second policy. In some embodiments, a virtual disk includes the first region and the second region.

A system, method and apparatus to facilitate data exchange via pointers. For example, in a computing system having a first processor and a second processor that is separate and independent from the first processor, the first processor can run a program configured to use a pointer identifying a virtual memory address having an ID of an object and an offset within the object. The first processor can use the virtual memory address to store data at a memory location in the computing system and/or identify a routine at the memory location for execution by the second processor. After the pointer is communicated from the first processor to the second processor, the second processor can access the same memory location identified by the virtual memory address. The second processor may operate on the data stored at the memory location or load the routine from the memory location for execution.

Example tiered storage systems, storage devices, and methods provide intelligent data access across tiered storage systems. An example system can comprise one or more computing devices, a file system, an object storage system comprising an object storage, and a data tiering application. The data tiering application is executable by one or more computing devices to perform operations comprising determining, using machine learning logic, a cluster of associated files stored in the file system; and archiving the cluster of associated files from the file system to the object storage coupled for electronic communication to the file system via a computer network.

A systems and method for reconfigurable and/or updatable lightweight electronic devices are disclosed for a computer system for facilitating financial transactions and reducing the opportunity for fraud. Via use of such a device, system, or method, various capabilities for a user are provided, simplified, secured, and/or made more convenient. The system may interact with various other devices or systems, including those that are cloud-based or communicate through the cloud, and may utilize various local sensors, in order to provide one or more of improved access, monitoring, user diagnostics, and so forth.

A low-latency file system file address space management method and system, and a medium. The method of the present invention comprises: generating a superblock and a block group allocation table from an address space of a storage device, wherein the superblock stores file system information and the allocation situation of block groups on a liner address space of the storage device, and the block group allocation table is used for marking the allocation situation of data blocks in the corresponding block group; when a file is created, dynamically creating or selecting a corresponding block group according to the size of a specified data block and allocating the data block; and writing file data into the allocated data block, and updating the block group allocation table and information of the superblock.

A call with respect to data for a file from an application program running on a computing device to a block-oriented file access function of an operating system running on the computing device is intercepted. A DAX file access is responsively performed with respect to a memory region of a persistent memory storing the file and an application buffer for the application program within an application memory space to which the memory region has been mapped.

The present disclosure provides a method and apparatus for writing data in an append mode, a device and a storage medium. The present disclosure relates to the field of cloud storage technology, and can be applied to a cloud platform. The method includes: acquiring to-be-written data, and writing the to-be-written data into a magnetic disk; writing first index information of the to-be-written data in a memory; storing, in response to determining that the number of pieces of second index information is greater than a first preset threshold, the second index information into storage hardware, the second index information including the first index information; and writing first identifier information corresponding to the second index information in the memory.

A storage device includes a nonvolatile semiconductor memory device including a plurality of physical blocks and a memory controller. The memory controller is configured to associate one or more physical blocks to each of a plurality of stream IDs, execute a first command containing a first stream ID received from a host, by storing write data included in the write IO in the one or more physical blocks associated with the first stream ID, and execute a second command containing a second stream ID received from the host, by selecting a first physical block that includes valid data and invalid data, transfer the valid data stored in the first physical block to a second physical block, and associate the first physical block from which the valid data has been transferred, with the second stream ID.