G06F11/2097

MAINTAINING THE BENEFIT OF PARALLEL SPLITTING OF OPS BETWEEN PRIMARY AND SECONDARY STORAGE CLUSTERS IN SYNCHRONOUS REPLICATION WHILE ADDING SUPPORT FOR OP LOGGING AND EARLY ENGAGEMENT OF OP LOGGING

Systems and methods are described for performing persistent inflight tracking of operations (Ops) within a cross-site storage solution. According to one embodiment, a method comprises maintaining state information regarding a data synchronous replication status for a first storage object of a primary storage cluster and a second storage object of a secondary storage cluster. The state information facilitates automatic triggering of resynchronization for data replication between the first storage object and the second storage object. The method includes performing persistent inflight tracking of I/O operations with a first Op log of the primary storage cluster and a second Op log of the secondary storage cluster, establishing and comparing Op ranges for the first and second Op logs, and determining a relation between the Op range of the first Op log and the Op range of the second Op log to prevent divergence of Ops in the first and second Op logs and to support parallel split of the Ops.

Adaptive query routing in a replicated database environment

Technologies are described providing adaptive query routing in a replicated database environment. The technologies can be used with a variety of replication protocols. Prepared statements, such as for queries, from a database client can be routed to a source node, or a source node and available replica nodes, when a replica node becomes unavailable. When a replica node becomes available again, a prepared statement can be updated to indicate that the updated prepared statement can be executed at nodes including the replica node that is available again. Prepared statement routing can also be used when a portion of replicated data becomes unavailable at a replica node, but a portion of replicated data remains available.

Fail-safe redundancy in aggregated and virtualized solid state drives

A solid state drive having at least one component solid state drive, a spare solid state drive, and a drive aggregator. The drive aggregator has at least one host interface, at least one drive interface connected to the at least one component solid state drive, and an interface connected to the spare solid state drive. The drive aggregator is configured to maintain, in the spare solid state drive, a copy of a dataset that is stored in the component solid state drive. In response to a failure of the component solid state drive, the drive aggregator is configured to substitute a function of the component solid state drive with respect to the dataset with a corresponding function of the spare solid state drive, based on the copy of the dataset maintained in the spare solid state drive.

Dynamic feedback technique for improving disaster recovery replication performance

A dynamic feedback technique improves data replication performance by balancing rates of data retrieval and data transmission of a fragmented virtual disk replicated between nodes of clusters on a local site and a remote site of a disaster recovery environment. Each node is embodied as a physical computer with hardware resources, such as processor, memory, network and storage resources, which are virtualized to provide support for one or more user virtual machines executing on the node. The storage resources include storage devices of an extent store, whereas the network includes a wide area network connecting the local and remote sites. The dynamic feedback technique employs a virtual memory buffer configured to balance the data storage retrieval and network transmission rates at a source of replication based on bandwidth demands of the extent store and network throughput as manifested by an available free space (i.e., emptiness) of the virtual buffer.

ENCRYPTION FOR A DISTRIBUTED FILESYSTEM

A computing device comprising a frontend and a backend is operably coupled to a plurality of storage devices. The backend comprises a plurality of buckets. Each bucket is operable to build a failure-protected stripe that spans two or more of the plurality of the storage devices. The frontend is operable to encrypt data as it enters the plurality of storage devices and decrypt data as it leaves the plurality of storage devices.

RESYNCHRONIZATION TO A SYNCHRONOUS REPLICATION RELATIONSHIP

Techniques are provided for resynchronizing a synchronous replication relationship. Asynchronous incremental transfers are performed to replicate data of a storage object to a replicated storage object. Incoming write requests, targeting the storage object, are logged into a dirty region log during a last asynchronous incremental transfer. Metadata operations, executed on the storage object, are logged into a metadata log during the last asynchronous incremental transfer. Sequence numbers are assigned to the metadata operations based upon an order of execution. The metadata operations are replicated to the replicated storage object for execution according to the sequence numbers, and the dirty regions are replicated to the replicated storage object in response to the metadata operations having been replicated to the replicated storage object. The storage object and replicated storage object are transitioned to a synchronous replication state where incoming operations are synchronously replicated to the replicated storage object.

DATA PROCESSING METHOD FOR DISTRIBUTED STORAGE SYSTEM, APPARATUS, AND ELECTRONIC DEVICE
20230033754 · 2023-02-02 ·

Provided are a data management method for a distributed storage system, an apparatus, and an electronic device. The method comprises: sending to each storage server a first request for acquiring data copy information; and according to the data copy information returned by each storage server in response to the first request, updating mapping data used to reflect the correspondence between the data copy information and the storage servers.

Systems and methods for managing distributed database deployments

Various aspects provide for implementation of a cloud service for running, monitoring, and maintaining cloud distributed database deployments and in particular examples, provides cloud based services to run, monitor and maintain deployments of the known MongoDB database. Various embodiments provide services, interfaces, and manage provisioning of dedicated servers for the distributed database instances (e.g., MongoDB instances). Further aspects, including providing a database as a cloud service that eliminates the design challenges associated with many distributed database implementations, while allowing the client's input on configuration choices in building the database. In some implementations, clients can simply identity a number of database nodes, capability of the nodes, and within minutes have a fully functioning, scalable, replicated, and secure distributed database in the cloud.

Methods and systems of an all purpose broadband network with publish subscribe broker network

A first optimization server including a first publish-subscribe broker is configured to connect to a first cellular base transceiver station, where the first cellular base transceiver station is configured to communicatively connect to entities, including a first entity, in an RF coverage area of the first cellular base transceiver station. A second optimization server includes a second publish-subscribe broker, where the first publish-subscribe broker and the second publish-subscribe broker are part of a publish-subscribe broker network that is operable to distribute published data packets between entities that are connected to a publish-subscribe broker of the publish-subscribe broker network, where the publish-subscribe broker network is configured to route data packets published by the first entity to a second entity via the first publish-subscribe broker and the second publish-subscribe broker if the second entity has subscribed to receive the data packets published by the first entity.

IMMUTABLE SNAPSHOT COPIES STORED IN WRITE ONCE READ MANY (WORM) STORAGE
20230032714 · 2023-02-02 ·

Techniques are provided for storing immutable snapshot copes in write once read many (WORM) storage. A snapshot of a volume may be stored into one or more objects formatted according to an object format. An expiry time may be assigned to the snapshot and the one or more objects based upon a creation time of the snapshot and a retention time. The one or more objects may be stored within a remote object store. The one or more objects are retained in an immutable state and cannot be deleted until expiration of the expiry time. In response to identifying an existing object within the remote object store comprising shared snapshot data referenced by the snapshot, an assigned expiry time of the existing object may be modified based upon the expiry time of the snapshot to create a modified expiry time for the existing object.