Object scriptability methods and system are described herein. The method includes generating a graph-based data structure including a plurality of nodes, where each node from the plurality of nodes represents a respective data-analysis object in a data analysis system, where each node from the plurality of nodes is connected to at least one other node from the plurality of nodes by an edge, where the edge represents a relationship between the respective objects in the data analysis system, and where generating the graph-based data structure includes receiving a high-level language script describing at least one data-analysis object, and generating at least one node from the plurality of nodes in accordance with the high-level language script.

Systems and methods for entering and storing data. User input defining a data set is received. A data collection construct including a data entry user interface for inputting data in the data set is defined using the user input. A data storage construct including queries for retrieving the data is automatically defined based on the user input. Additional user input indicating modifications to the data set is received. The data collection construct, the data storage construct, and the queries are automatically updated based on the additional user input indicating modifications to the data set.

A data processing system that provides access to operator state information includes a plurality of operators that are configured to perform a computation with respect to data received from data sources. State information is associated with at least one of the plurality of operators. The data processing system also includes an object graph that comprises a representation of the computation, and that may dynamically change at runtime. The data processing system also includes an interface that provides access to the state information via the object graph. The data processing system also includes a query manager that is executable to process a graph query to retrieve the state information by traversing a plurality of nodes within the object graph. Temporal navigation is also supported. Thus, processing a graph query may involve navigating to a node in the object graph at a certain point in time.

Systems and methods for entering and storing data. User input defining a data set is received. A data collection construct including a data entry user interface for inputting data in the data set is defined using the user input. A data storage construct including queries for retrieving the data is automatically defined based on the user input. Additional user input indicating modifications to the data set is received. The data collection construct, the data storage construct, and the queries are automatically updated based on the additional user input indicating modifications to the data set.

A metadata-based scientific data characterization method, system, and computer program product include requesting a user input for a task to specify a rule for the task to determine a quality and a relationship of a data file in a data file database based on metadata associated with the data file, processing a user feedback of results using the rule run on the data file database and tracking the user feedback on the results in order to learn from the user feedback, and based on the learning, creating a modified rule to determine a quality and a relationship of a second data file.

Object scriptability includes receiving a high-level language script describing at least one data-analysis object, including a node representing the data-analysis object in a graph-based data structure including a plurality of nodes, where each node from the plurality of nodes represents a respective data-analysis object in a data analysis system, where each node from the plurality of nodes is connected to at least one other node from the plurality of nodes by an edge, and where the edge represents a relationship between the respective objects in the data analysis system.

Some embodiments provide a method of emulating a presentation of at least one system object of a first database, based on multiple system objects of a second database. From a client, the method receives a first query for the first database requesting a presentation of the system object. From a metadata storage, the method identifies a second query for the second database that references the system objects of the second database, and generates the requested presentation of the system object. The method replies to the client with the generated presentation.

A code generator platform may receive source metadata and a target data model. The code generator platform may determine a parameter, of the target data model, that is associated with the attribute. The code generator platform may map, based on the attribute and the source metadata, the data to the parameter of the target data model. The code generator platform may generate, based on mapping the data to the parameter, data transformation code associated with the data and the target data model, wherein the data transformation code, when executed, generates target data that corresponds to the data according to the target data model. The code generator platform may perform an action associated with the data transformation code to permit the data transformation code to be executed in order to update a target database with the target data.

Optimizing transaction times for distributed databases is described. A system receives a request which specifies an identifier of a database record associated with a distributed database. If the request is associated with a primary database of the distributed database, any user-defined function is associated with the database record in the primary database, and any associated user-defined function does not require any call that is external to a subnet and/or a firewall associated with the primary database, then the system executes, within the subnet and/or the firewall associated with the primary database, each associated user-defined function for the database record in the primary database. The system outputs a result which is based on executing any associated user-defined functions.

Methods, systems, devices, and tangible non-transitory computer readable media for configuring and implementing application policies are provided. The disclosed technology can access application policy data associated with implementing an application policy. The application policy data can include rules associated with implementing the application policy by using organizational data associated with a plurality of applications that includes a set of extra-organizational applications that perform operations associated with a different set of extra-organizational applications. Based on the application policy data, organizational records of the organizational data that satisfy the one or more rules can be determined. The plurality of applications associated with the one or more organizational records that satisfy the one or more rules can then be accessed. Furthermore, based at least in part on the application policy and the one or more organizational records, the one or more operations associated with implementing the application policy can be performed.