A method and system for capturing dynamic data from data fields of a product has been developed. The method includes first collecting a product data set with multiple data fields. Static data fields of the product data set are identified that contain pre-defined standardized data for multiple other data sets. Next, dynamic data fields of the data set are identified. A dynamic data field is created by a user and contains additional data that is unique and applicable only to the product data set. The static data fields and the dynamic data fields are stored separately in a database repository for later recovery.

In some examples, a plurality of nodes may each host a respective logical database (LDB) that includes database data that references external resources stored in a storage system. Further, each node may maintain, for each external resource referenced by the respective LDB on that node, a reference count of a number of references in the respective LDB to each external resource and a timestamp associated with the reference count. In response to addition of a reference to a particular external resource in a particular LDB, a node that hosts the particular LDB may be programmed to increment the reference count and update the timestamp for the particular external resource. Similarly, in response to removal of the reference to the particular external resource in the particular LDB, the node hosting the particular LDB is programmed to decrement the reference count and update the timestamp for the particular external resource.

Systems, methods and program instructions are described for calling a database function with a URL. Many databases have functions, also referred to as logical elements, built into the database that can be called to retrieve data. A web URL can be used to call such a programming function by formatting the URL in a specific manner. A URL and dynamic values from the client are received. The URL can be parsed to determine the resource path and parameters, if any exist. The database function specified in the URL is called using the specified parameters, if any exist, and using the dynamic values from the client. The results can be streamed to the user.

A computer system access feed data belonging to a particular feed, and executes a dynamic server statement to create a relational dataset with data type fields from the feed data in an in-memory table of the server. The dynamic server statement is stored within metadata associated with the feed. The computer system also applies a second dynamic server statement to the data feed which applies one or more data processing conditions indicated in the metadata. The second dynamic server statement is also stored within the metadata associated with the feed. Upon determining that one or more feed data rows match the data processing conditions, the computer system places feed data row information about the matching data rows into an alert table that includes references to a regional blob table with blob data, thereby triggering an alert.

A method, computer program product and system are provided. The method, computer program product and system execute a process for storing an object in an object container that is stored in a persistency of a disk storage. The object container has size criteria whereby objects meeting the size criteria of the object container can be assigned to the object container. The object container can facilitate storing multiple objects to optimize disk storage usage by facilitating the assigning of multiple objects to the same disk storage page.

A method, computer program product and system are provided. The method, computer program product and system execute a process for storing an object in an object container that is stored in a persistency of a disk storage. The object container has size criteria whereby objects meeting the size criteria of the object container can be assigned to the object container. The object container can facilitate storing multiple objects to optimize disk storage usage by facilitating the assigning of multiple objects to the same disk storage page.

Systems and methods of a configuration distribution microservice include reception of a first data structure comprising first configuration data of a first type and associated with a first tenant of a first microservice, determination of one or more other microservices associated with the first tenant and the first type of configuration data, and transmission of an instruction to the determined one or more other microservices to deploy the first configuration data.

A streaming ingest platform can improve latency and expense issues related to uploading data into a cloud data system. The streaming ingest platform can organize the data to be ingested into per-table chunks and per-account blobs. This data may be committed and may be made available for query processing before it is ingested into the target source tables. This significantly improves latency issues. The streaming ingest platform can also accommodate uploading data from various sources with different processing and communication capabilities, such as Internet of Things (IOT) devices.

Techniques are described herein for leveraging and extending relational data sharding infrastructure to provide comprehensive support for sharding semi-structured and unstructured data, in addition to the relational data, in a single sharded database system. Specifically, techniques are described in which a catalog server pre-gathers all data it needs to answer fetches from a dynamically created temporary lob. In addition, techniques are provided in which a catalog server encodes shard identifiers in lob locators sent to the client. Techniques are provided for pushing down various operators to shard servers.

A method includes identifying a database install script to be executed for a given database and parsing the database install script prior to execution to determine an object type, object name and object operation for database objects affected by the database install script. The method also includes connecting to the given database to read a definition of the database install script based at least in part on the object type, object name and object operation for the database objects affected by the database install script and generating a rollback script based at least in part on the definition of the database install script. The method further includes executing the database install script on the given database and, responsive to detecting one or more designated conditions, utilizing the rollback script to revert one or more changes to the database objects affected by the database install script.