Methods, systems, devices, and tangible non-transitory computer readable media for configuring and implementing application policies are provided. The disclosed technology can access application policy data associated with implementing an application policy. The application policy data can include rules associated with implementing the application policy by using organizational data associated with a plurality of applications that includes a set of extra-organizational applications that perform operations associated with a different set of extra-organizational applications. Based on the application policy data, organizational records of the organizational data that satisfy the one or more rules can be determined. The plurality of applications associated with the one or more organizational records that satisfy the one or more rules can then be accessed. Furthermore, based at least in part on the application policy and the one or more organizational records, the one or more operations associated with implementing the application policy can be performed.

Systems and methods for building and publishing schemas based on data patterns and data formats are disclosed. According to one embodiment, a method for building and publishing schemas may include: (1) accessing, by a schema recommendation program executed by a computer processor, a plurality of ingested objects in an object store; (2) extracting, by a data crawler, metadata from each of the plurality of ingested objects, wherein the metadata is related to a schema for the object and comprises an object name, a field name, and a field type; (3) identifying, by the data crawler, a plurality of potential schemas for the plurality of ingested objects based on the metadata; (4) receiving, by the schema recommendation program, a selection of one of the plurality of potential schemas; and (5) publishing, by the schema recommendation program, the selected potential schema to a catalog store.

A method, a system, and a computer program product for accessing data. A schema representing a structure of an object in a plurality of objects stored in a storage location is generated. Each object includes one or more data elements. Each schema identifies one or more data elements of the object, an offset location of each data element of the object, and a value of each data element of the object. A query requesting access to one or more data elements is received. A generated schema in a plurality of generated schemas representing the queried object is identified. The elements are accessed using the identified generated schema, and retrieved.

Techniques are disclosed in which a computer system implements schema changes for existing database objects by maintaining a logical name and a current physical name corresponding to an existing database object, where the logical name points to the current physical name. The system receives a schema change request specifying the logical name and format changes for the existing object. The system performs a schema change operation in response to the request, including: creating a new database object having a new physical name, copying and transforming data from the existing object to the new object according to the format changes, mirroring new writes directed to the logical name to both the existing and new objects, and causing the logical name to point to the new physical name instead of the current physical name after completing the copying. The system responds to subsequent queries, specifying the logical name, from the new object.

A schema associated with a type of document is received. A set of documents are queried for documents that match the schema, wherein the query is performed while bypassing user intervention. A subset of documents of the set of documents is identified that match the schema. The subset of documents that match the schema are transmitted to a document controller.

A drift analysis system (DAS) is described that is capable of automatically detecting potential model schema drift issues when a machine learning model (MIL model), which has been trained using a particular training dataset, is used to make a prediction for a particular input provided to the model. The DAS performs one or more drift checks by comparing characteristics of the input to characteristics of the training dataset that was used to train the model that is being used to make a prediction for the input. Results obtained by the DAS from performing the drift checks may then be output along with the prediction made for the particular input. The one or more drift check results may be compiled into a drift report, which may be served concurrently with prediction results generated by the trained machine-learning model for the input.

Systems and methods herein describe embodiments for handling a data drift. An example system accesses the data pipeline, which is comprised of a plurality of stages. For each stage of the plurality of stages in the data pipeline, the system identifies stage schema fields for processing data in the data pipeline and generates a set of stage schema fields comprising the identified stage schema fields in the stage. In response to detecting an origin stage, the system generates a set of pipeline schema fields, whereby the set of pipeline schema fields comprise a union of the generated sets of stage schema fields. The set of pipeline schema fields are then stored.

Methods, systems, and computer-readable storage media for providing a first access schema in a view layer of the database system, the first access schema including first database objects and projection views, each projection view corresponding to a second database object of second database objects in a data persistency, transitioning access of sessions of an application from the data persistency to the first access schema, executing at least a portion of the maintenance procedure in the database system, the at least a portion of the maintenance procedure changing one or more second database objects within the data persistency, creating a second access schema, and transitioning access of the sessions of the application from the first access schema to the second access schema, transitioning access of the sessions of the application from the second access schema to the data persistency, and removing the second access schema from the database system.

Randomized testing can be used to explore a set of possible transactions, schemas, and system states, including partionings, which can exist in a distributed database. The tests can be complementary to other system failure, performance, and version compatibility tests. Randomly generated transactions can be computed or evaluated at a transactor and compared to results derived from a transactor emulator.

A schema associated with a type of document is received. A set of documents are queried for documents that match the schema, wherein the query is performed while bypassing user intervention. A subset of documents of the set of documents is identified that match the schema. The subset of documents that match the schema are transmitted to a document controller.