An embodiment generates, responsive to receiving a declarative replication specification, a logical map comprising a plurality of paths to completing a data replication process identified by the replication specification. The embodiment determines, responsive to generating the logical map, an optimal path to completing the data replication process by searching the plurality of paths of the logical map using a cost-directed search algorithm to find the optimal path from among the plurality of paths. The embodiment also performs, responsive to finding the optimal path, a series of data replication operations for replicating source data on a target database. The embodiment also detects, during a runtime of the data replication process, a predetermined change to a runtime environment of the data replication process. The embodiment also determines, responsive to detecting the predetermined change, a revised optimal path for performing the data replication process in the changed runtime environment.

The present disclosure provides a generic multi-source heterogeneous large-scale data system, including a sync node config unit, an install & deployment unit, a block & pipelining unit, a unilateral sync unit, a bilateral sync unit and a correctness guarantee unit. The system operates on a middle layer which is above a node database layer and beneath an application logic layer. In a data synchronization process, a client end transmits captured local change information to a server end in accordance with a synchronization task plan; the server end receives and transfers the change information to an asynchronous parallel message processing mechanism to be stored in a corresponding message queue; the server end polls a local message queue for reading to-be-processed change information, and then performs subsequent data change in accordance with rules for heterogeneous data mapping, so as to maintain consistence of synchronized data objects between a source end and a target end. The system of the present disclosure operates independently in a manner parallel to local applications of a synchronous node, and provides a guarantee mechanism of relaxed transaction for Internet distributed multi-source heterogeneous data synchronization through collaboration of loose coupling.

A method in an intermediate server of initiating updates to a secondary database based on activity in a primary database includes: retrieving primary data from a primary server hosting the primary database; retrieving secondary data from a secondary server hosting the secondary database; storing a combined data set including the primary data and the secondary data; responsive to receiving a request from a client device, presenting a portion of the combined data set to the client device; receiving, from the client device, input data associated with the portion of the combined data set and updating the combined data set in the memory; determining whether to synchronize the updated combined data set with at least one of the primary server and the secondary server; and when the determination is affirmative, selecting a subset of the combined data set for transmission to at least one of the primary and secondary servers.

An apparatus for a local area network includes a management communications bus, and at one of a plurality of logic nodes, logic circuitry. The management communications bus is for communication among the plurality of logic nodes, wherein respective node addresses for the plurality of logic nodes are conveyed using the management communications bus. The logic circuitry communicates information in a data/address field of the communications protocol with another of the plurality of logic nodes with reference to a subset of the predetermined set of patterned data bits in the data/address field to synchronize the transactions.

Providing continuous data protection includes maintaining a database having substantially all data modifications made to a primary volume over a recovery interval. The database is maintained in conjunction with a copying operation where the data of the primary volume are mirrored to a remote volume to permit recovery of mirrored data in the event of loss of primary volume data. The contents of the remote volume generally lag behind the contents of the primary volume by substantially the recovery interval. Providing continuous data protection also includes providing data roll-back to a precise point in time within the recovery interval by applying, to the contents of the remote volume, all data modifications in the database that occurred between the latest data modification to the remote volume and the precise point in time within the recovery interval. A time stamp mechanism of sufficient precision and granularity may be used.

A selection device includes a storage unit and a selection unit. The storage unit stores the write time and the read time of each of a plurality of nodes. The selection unit selects a first response condition in response to a data write request on the basis of the write time of each of the plurality of nodes such that the response time for the data write request becomes shorter than a requirement value of the write time and the number of nodes in which writing has been completed increases. The selection unit selects a second response condition in response to a data read request on the basis of the first response condition and the read time of each of the plurality of nodes such that the response time for the data read request becomes shorter than a requirement value of the read time.

A system is provided for resolving data errors. The system is configured to obtain an erroneous data element received from a source system and generate a plurality of probable data values for the data element. For each probable data value of the plurality of probable data values, the system verifies whether the probable data value can be processed successfully by an Extract, Transform and Load (ETL) logic and by one or more target applications configured to process the data element. The system determines one of the probable data values as a suggested data value of the data element, based on the verification of the probable data values. The system outputs the suggested data value for processing by the ETL logic.

In various embodiments, a data storage system maintains a data store for a plurality of groups of users, where the data store includes a first section that is accessible by a first group of users, but not a second group of users, via the data storage system. In response to receiving, from a first user of the first group of users, a request to share data with the second group of users, the data storage system sends a request to a second user of the second group of users. Subsequent to receiving an acceptance from the second user, the data is stored in a second object in a second section of the data store that is accessible by the second group of users, but not the first group of users, via the data storage system.

A data analytics system stores a plurality of sequential data blocks in a block cache. Each data block contains one or more data records. Each data record of a data record contains one or more values and a record marker marking the end of the data record. The data analytics system allocates a data block in the block cache to a worker thread. The worker thread parses the data block to identify the one or more data records contained within the data block. The data analytics system determines whether the data block was correctly parsed. Responsive to determining that the data block was correctly parsed, the data analytics system provides the one or more data records contained within the data block to a data analytics workflow.

In an example embodiment, an additional interface customer resource definition (CRD), which operates in conjunction with the normal CRD, is utilized. The interface CRD may be called a service CRD. The service CRD provides an abstraction of the original CRD by abstracting away all technical details that no other services should depend upon. The service CRD provides a facade to the original CRD. Both are kept in sync by a component called an operator, which infers the specification of the original CRD on the basis of the specification of a given service CRD. Furthermore, status updates sent to the original CRD that are relevant to the dependent services are mirrored back to the corresponding service CRD. Correspondingly, status updates with technical details that are too specific for the dependent services are not mirrored back.