Provided herein are devices, systems, methods and various means, including those related to providing a community internet drive that may utilize a centrally-managed hub as well as storage devices distributed among various networked machines. In some embodiments, the community internet drive can also include features to enable its users to promote and utilize the user's trusted personal relationships while also enabling an open platform for peer-to-peer and/or other types of sharing schemes.

A method and system for executing database queries in parallel using a shared metadata store. The metadata store may reside on a master node, where the master node is the root node in a tree. The master node may distribute query plans and query metadata to other nodes in the cluster. These additional nodes may request additional metadata from each other or the master nodes as necessary.

As disclosed herein a computer system for secure database backup and recovery in a secure database network has N distributed data nodes. The computer system includes program instructions that include instructions to receive a database backup file, fragment the file using a fragment engine, and associate each fragment with one node, where the fragment is not stored on the associated node. The program instructions further include instructions to encrypt each fragment using a first encryption key, and store, randomly, encrypted fragments on the distributed data nodes. The program instructions further include instructions to retrieve the encrypted fragments, decrypt the encrypted fragments using the first encryption key, re-encrypt the decrypted fragments using a different encryption key, and store, randomly, the re-encrypted fragments on the distributed data nodes. A computer program product and method corresponding to the above computer system are also disclosed herein.

In one embodiment, a method for tensor data distribution using a direct-memory access agent includes generating, by a first controller, source addresses indicating locations in a source memory where portions of a source tensor are stored. A second controller may generate destination addresses indicating locations in a destination memory where portions of a destination tensor are to be stored. The direct-memory access agent receives a source address generated by the first controller and a destination address generated by the second controller and determines a burst size. The direct-memory access agent may issue a read request comprising the source address and the burst size to read tensor data from the source memory and may store the tensor data into an alignment buffer. The direct-memory access agent then issues a write request comprising the destination address and the burst size to write data from the alignment buffer into the destination memory.

From the enterprise cloud to robot swarms, distributed systems are everywhere. However, because these systems are realized through the careful coupling of disparate technologies (e.g., databases, messaging systems, and application runtimes), they are difficult to create and maintain—even for experienced engineers. This is a problem because the engineers of these systems have to work harder, be better trained, and thus cost more to employ, making it harder to create new products and inventions. A solution herein is a Data Backbone that provides a single medium for processing, storing, and sharing data in near-real-time. By combining these features into a single medium, the Data Backbone consolidates the functionality of several disparate tools into one system.

From the enterprise cloud to robot swarms, distributed systems are everywhere. However, because these systems are realized through the careful coupling of disparate technologies (e.g., databases, messaging systems, and application runtimes), they are difficult to create and maintain—even for experienced engineers. This is a problem because the engineers of these systems have to work harder, be better trained, and thus cost more to employ, making it harder to create new products and inventions. A solution herein is a Data Backbone that provides a single medium for processing, storing, and sharing data in near-real-time. By combining these features into a single medium, the Data Backbone consolidates the functionality of several disparate tools into one system.

One embodiment of the present invention provides a system for caching content data to a storage device attached to a node in a content-centric network (CCN). During operation, the system receives a content packet; forwards the content packet to an incoming port of an interest in the content packet; caches a copy of the content packet in the attached storage device, assembles a query; which includes at least a network header and an address associated with storage blocks at which the cached copy of the content packet is located, corresponding to the content packet; and stores the query in a cache table, thereby facilitating a subsequent direct access to the storage blocks using the assembled query to retrieve the copy of the content packet.

Systems and methods are disclosed for cross-system storage management for transferring data across autonomous information management systems. Data may be transferred from one information management system to another information management system without interfering with or overriding each system's autonomy. For example, a secondary copy of production data (e.g., backed up data) is transferred from a first information management system that originated the data to a component of another “foreign” information management system. A first storage manager that manages the first information management system also manages the cross-system data transfer operation to a “foreign” client computing device, which remains under autonomous management as a component of the foreign information management system.

To distribute messages to subscribers that are located in multiple regions, a data center will receive messages that to be published to the subscribers. The data center will then perform a limited replication process to other data centers in other regions by accessing an interest map indicating additional data centers at which subscribers have recently expressed interest. The data center will transmit the messages to only that group of additional data centers for replication but not to other data centers at which no interest has been recently expressed.

To distribute messages to subscribers that are located in multiple regions, a data center will receive messages that to be published to the subscribers. The data center will then perform a limited replication process to other data centers in other regions by accessing an interest map indicating additional data centers at which subscribers have recently expressed interest. The data center will transmit the messages to only that group of additional data centers for replication but not to other data centers at which no interest has been recently expressed.