Methods and apparatuses in a cloud-based database management system are described. Data in a database are stored in a plurality of pages in a page store of the database. A plurality of redo log records are received to be applied to the database. The redo log records within a predefined boundary are parsed to determine, for each given redo log record, a corresponding page to which the given log record is to be applied. The redo log records are reordered by corresponding page. The reordered redo log records are stored to be applied to the page store of the database.

Systems and methods are provided for optimizing data structures to improve the data retrieval through the use of bucketing techniques. A number of objects within an environment is drastically reduced utilizing bucketing techniques. Within the buckets, items are sequentially organized such that location is quicker. Items, or keys, are aligned with the same hash value together in a bucket and a mapping of the hash value to the offset of the first key occurrence in that bucket. This guarantees each lookup operation is only two random read accesses. Systems and methods provided herein control the pressures on a system for garbage collection and minimize memory usage with minimal impacts on performance.

Systems and methods are provided for optimizing data structures to improve the data retrieval through the use of bucketing techniques. A number of objects within an environment is drastically reduced utilizing bucketing techniques. Within the buckets, items are sequentially organized such that location is quicker. Items, or keys, are aligned with the same hash value together in a bucket and a mapping of the hash value to the offset of the first key occurrence in that bucket. This guarantees each lookup operation is only two random read accesses. Systems and methods provided herein control the pressures on a system for garbage collection and minimize memory usage with minimal impacts on performance.

Systems and methods are provided for using point-in-time architecture (PTA) databases. An exemplary method includes: entering first data, received from a first data source, into a first PTA database; receiving a first instruction to process the first data using a first statistical operation; executing the first statistical operation for the first data, resulting in first output data; filtering the first output data based on a user-selected attribute; and performing multiple stages of a data processing operation for the first output data.

Systems and processes for efficient accessing, storing and transmitting of fixed data elements and dynamic data elements, each having its own native form. The data elements are organized according to a schema, with (a) all fixed data elements stored in their native forms in a fixed memory allocation, and (b) each dynamic data element stored in memory in its own native form, in its own data allocation. With this memory structure, computational overhead of converting data elements from their native forms to JSON, XML or other markup language is avoided, making accessing data (getting), updating data (setting), converting data to a serial stream for transmission or other manipulation (serializing), deserializing, and other manipulations of the data elements much more CPU efficient and requiring less bandwidth.

A method for execution by a dispersed storage network (DSN) managing unit includes receiving access information from a plurality of distributed storage and task (DST) processing units via a network. Cache memory utilization data is generated based on the access information. Configuration instructions are generated for transmission via the network to the plurality of DST processing units based on the cache memory utilization data.

Providing access to usage reports on a cloud-based data warehouse including maintaining, by a management module, a metadata table on the cloud-based data warehouse, wherein the metadata table comprises usage reports for a plurality of organizations; receiving, by the management module, a request for the metadata table from an administrator account for a first organization of the plurality of organizations; granting, by the management module, the administrator account permission to access a filtered portion of the metadata table, wherein the filtered portion of the metadata table is generated by filtering the metadata table by an organization identifier of the first organization; and providing, by the management module, the filtered portion of the metadata table to the administrator account.

Providing access to usage reports on a cloud-based data warehouse including maintaining, by a management module, a metadata table on the cloud-based data warehouse, wherein the metadata table comprises usage reports for a plurality of organizations; receiving, by the management module, a request for the metadata table from an administrator account for a first organization of the plurality of organizations; granting, by the management module, the administrator account permission to access a filtered portion of the metadata table, wherein the filtered portion of the metadata table is generated by filtering the metadata table by an organization identifier of the first organization; and providing, by the management module, the filtered portion of the metadata table to the administrator account.

The present disclosure provides systems and methods that generate query templates that are expressed in a generic schema-agnostic language. The query templates can be generated “from scratch” or can be automatically generated from existing queries, a process which may be referred to as “templatizing” the existing queries. As one example, generation of query templates can be performed through an iterative process that iteratively generates candidate templates over time to optimize a coverage over a set of existing queries. After generation of the schema-agnostic query templates, the systems and methods described herein can automatically translate/map the templatized queries into “concrete,” schema-specific queries that can be evaluated over specific customer schemas/datasets. In this manner, a query template for a given semantic query (e.g., “return the names of all employees”), is required to be written only once.

The present management system includes a design database recording member identification information and member shape information on construction members constituting a construction object, a measurement database recording point coordinates of measurement points of the construction object, a member shape information acquiring unit configured to acquire the member shape information of a shape calculation member selected among the construction members recorded in the design database, a member in-range determining unit configured to determine whether coordinates of an object point selected among the measurement points recorded in the measurement database are of the shape calculation member by using the member shape information of the shape calculation member, and an allocated measurement data creating unit configured to record the object point in association with member identification information of the shape calculation member in the measurement database.