A file access system for user defined functions (UDFs) can be implemented on a distributed database system. The system can store UDF signatures and interfaces (e.g., classes, sub-classes) that can be called by other users. Upon a UDF being called, one or more interface objects (e.g., InputStream) can be created and requests transferred to a execution node via a network channel. The execution node can implement multiple threads that are authorized and download file data from a staging location (e.g., internal stage, external stage) concurrently.

Disclosed herein are system, method, and computer program product embodiments for creating an enterprise data model that defines entities and relationships between the entities spanning multiple environments and for deploying and maintaining artifacts across the environments using metadata specified in the enterprise data model. By embedding metadata that describes foreign key references within an enterprise data model, a unifying enterprise data model may manage artifacts across multiple domains while implementing a physical, cross-domain, data architecture. Such an enterprise data model may provide an organization with a 360-degree view of the information harnessed across the organization's technical landscape and may allow the organization to easily rollout a comprehensive data warehousing solution.

A method, computer program and apparatus is disclosed. The method, performed by one or more processors, may comprise receiving, from one or more predetermined organizations, datasets representing entities and datasets representing one or more tasks for those entities and storing in a database, in accordance with an ontology which is common to the organizations, the received one or more datasets as data objects, the ontology defining properties of data objects and relationships between the data objects. The method may also comprise mapping the data objects stored in the database to the organization from which the one or more datasets were received and receiving, through a querying application, a query from a user of one of the predetermined organizations to view one or more data objects relating to a task. The method may also comprise identifying the organization to which the user is associated, generating, based on the mapping, a view including at least the one or more task data objects associated with the identified organization and not data objects associated with other organizations and displaying the view on a user interface.

A query referencing a function associated with a remote software component is received by a network-based data warehouse system. Temporary security credentials corresponding to a role at a cloud computing service platform are obtained. The role has permission to send calls to a web endpoint corresponding to the remote software component. A request comprising input data and electronically signed using the temporary security credentials is sent to a web Application Programming Interface (API) management system of the cloud computing service platform. The request, when received by the web API management system, causes the web API management system to invoke external functionality provided by the remote software component at the web endpoint with respect to the input data. A response comprising a result of invoking the external functionality is received from the web API management system, and the result data is processed according to the query.

Embodiments of the present disclosure may provide a data clean room allowing encryption based data analysis across multiple accounts, including different provider database user accounts that provide user data and a network service and a requesting user that generates one or more clean room requests. The data clean room may also restrict which data may be used in the analysis and may restrict the output.

Some embodiments provide a program that receives a request to apply a hierarchical rule definition to a set of data objects. Each data object in the set of data objects includes a set of attributes. The program further retrieves the hierarchical rule definition from a set of hierarchical rule definitions. Each hierarchical rule definition in the set of hierarchical rule definitions includes a hierarchy of rules. Each rule in the hierarchy of rules includes a set of criteria and a set of actions that are performed when the set of criteria are satisfied. The program also applies the hierarchical rule definition to each data object in a subset of the set of data objects by traversing the hierarchy of rules of the hierarchical rule definition and modifying the data object based on sets of criteria and sets of actions specified in the hierarchy of rules.

Systems and methods for range programming using a search query are disclosed. A method for range programming using a search query includes determining whether the search query comprises a range operation and identifying a target application to launch using a search application which is separate from the target application and based on the search query. A range of results to process with the target application can be identified using the search application and based on the search query. The results can be separately within the range in the context of the target application.

A method and system according to embodiments enable generalized program to program interoperability. The method and system employ an automatic or substantially automatic transform adapter for using a given exchange standard for two-way communication with a program. In order for the adapter to employ the exchange standard, a discovery manager may learn the program's data communications structure and/or format, and may learn data meaning information from the program. An adapter creator may derive a transform which converts the program's data communications structure and data meaning into the exchange standard. The transform may be used by the adapter to enable two-way communication with any adapter and/or program similarly employing the given exchange standard to achieve interoperability.

The system described herein provides for iteratively executing an algorithm across partitions of a database table, in parallel. An instance of the algorithm may be executed for each partition of a database table across different hosts, in parallel, using predefined control data. The system may receive a result corresponding to each partition in response to executing algorithm on the respective partition. The system may determine a result corresponding to each of the partitions satisfies predefined criteria. The predefined criteria is defined by the user. In response to determining that the result corresponding to a partition fails to satisfy the predefined criteria, the system may modify the control data and execute an instance of the algorithm on each of the partitions using the modified control data.

The insertion and processing of programming language code (e.g., C#) in SQL statements, and the dynamic compiling of the code to detect errors prior to statement execution. The SQL statement with arbitrary programming language code can then be executed concurrently as a query on a computer cluster. External libraries can be imported and the associated functionality leveraged from within a SQL statement. The programming language compiler performs checking at build time, rather than retuning an error during the statement execution against the cluster, a potentially costly proposition in both computing time and human resources.