In an embodiment, a hierarchical data structure includes data blocks separated into a plurality of data segments partitioned into a plurality of supersegments. Each data segment includes a predetermined number of data blocks. Each supersegment includes a predetermined number of data segments. Responsive to receiving data to store in the hierarchical data structure, a first subset of data segments are grouped into a first supersegment to allow a first portion of the data to be sequentially stored to a first set of data blocks in a first data segment of the first supersegment. Also, a second portion of the data is sequentially stored to a second set of data blocks in a second data segment of the first supersegment. Probabilistic membership query filters are generated at each different level for each data segment and the first supersegment of the hierarchical data structure to allow for efficient search and data retrieval.

A method and an apparatus for querying service data are provided. A database memory includes a column buffer and a row buffer, a column of the column buffer is used to load column data of a database, and a row of the row buffer is used to load column data of the column buffer or the column data of the database. When a transactional service data query request that is sent by a transactional service system and that includes a target column identifier and a first query condition is received, it is detected whether a row index corresponding to the target column identifier exists, and if yes, column data that corresponds to the target column identifier, and that is in a row that is in the row buffer and corresponds to the row index is queried based on the first query condition, to obtain a query result.

A network device includes a database that includes database entries, an external data that includes external data entries, an interpreter, and a standing query instance (SQI). The interpreter is programmed to convert an external data entry into a temporary database entry and provide the temporary database entry to the database. The SQI is programmed to obtain a database entry and the temporary database entry from the database and generate an output based on the database entry and the temporary database entry.

Techniques a provided for performing multi-system operations in which changes are asynchronously committed in multiple systems. Metadata about the multi-system operation is injected into the commit logs of one system involved in a multi-system operation. An event stream is generated based on the commit logs of the one system, and is used to drive the operations that one or more other systems need to perform as part of the multi-system operation. A reconciliation system reads the logs of all systems involved in the multi-system operation and determines whether the multi-system operation completed successfully. Techniques are also provided for using machine learning to generate models of normal execution of different types of operations, detect anomalies, pre-emptively send expectation messages, and automatically suggest and/or apply fixes.

An example operation may include one or more of a processor configured to receive a database command from a client system, the database command comprising a database function and parameters to be used by the database function, and to execute the database command on database data, and an interface configured to transmit the database command to one or more other databases that are within a decentralized database system in which each database node is controlled by a different entity, wherein in response to receiving a request from an ordering node of the decentralized database system, the processor may commit results of executing the database command to a database and store information about the database command in an append-only immutable database log.

A method of transferring data between database locations comprising: providing a location reference comprising location values of one or more data collections stored in a database; providing an indicator in association with at least one data collection of the one or more data collections, the indicator being provided in response to initiation of a transfer process of the at least one data collection from a first location of the database to a second location of the database; wherein the indicator is changeable between a first state and a second state, the first state being indicative of the initiation of the transfer process; and as part of the transfer process of the at least one data collection, selectively updating a location value of the at least one data collection in the location reference, in dependence on a determination of whether the indicator is in the first state or the second state.

Disclosed herein are exemplary systems and methods for garbage collection and/or deletion in a document database. The methods may include, for each change in a first change set, determining whether a first characteristic of the change is superseded by a second characteristic of a corresponding change in a second change set. The change of the first change set and the change of the second change set can pertain to a document attribute. The method may include determining whether the first change set is redundant with the second change set if each change of the first change set is superseded by a corresponding change of the second change set, and eliminating the first change set from the document database when the first change set is redundant with second change set.

Provided are a computer program product, system, and method for performing conflict analysis of replicated changes among nodes in a network A first node and a second node include a first instance and second instance of a data set, respectively. The second node receives a first transaction replicated from the first node, applied to the first instance of the data set. The second node determines a conflict that would occur between the replicated first transaction and a second transaction applied to the second instance of the data set. A conflict policy is applied at the second node to perform a first action in response to determining the conflict. The conflict policy is applied to the first node to perform a second action at the first node to handle the conflict when the first node receives a replication of the second transaction to the second instance of the data set.

A node includes storage that stores a portion of high accessibility data corresponding to a shard that is divided into revisions. The portion of the high accessibility data is managed based on an activity state model including a writing state, a resolving state, a metadata update state, and a reading state. The node further includes a repository manager that obtains a cross-shard read request for the high accessibility data; makes a determination that the portion of the high accessibility data is not in the reading state; in response to the determination, adds the cross-shard read request to a delayed action queue at the revision of a last delayed action in the delayed action queue; and after processing the last delayed action in the delayed action queue and while in the resolving state: converts the cross-shard read request to a read request; and processes the read request.

A value chain system that provides recommendations for designing a logistics system generally includes a machine learning system that trains machine-learned models that output logistics design recommendations based on training data sets that each respectively defines one or more features of a respective logistic system and an outcome relating to the respective logistics system; an artificial intelligence system that receives a request for a logistics system design recommendation and determines the logistics system design recommendation based on one or more of the machine-learned models and the request; and a digital twin system that generates an environment digital twin of a logistics environment that incorporates the logistics system design recommendation, and one or more physical asset digital twins of physical assets. The digital twin system executes a simulation based on the logistics environment digital twin, the one or more physical asset digital twins.