The present invention provides a robust and effective solution to an entity or an organization by allowing to visualize the flow of automotive data signals from a source system to a sink system with different metric signals at each step and creating a mechanism for creating automotive signal quality marker (ASQM) for high quality automotive data signals by determining high value data parameters, inter-parameter correlation, data quality variation with trip duration, and frequency of data collection/distribution across datasets. The quality criterion thus developed is applied to data generated from a plurality of data sources. The ASQM may be calculated by converting the developed automotive data signals quality criterion into a numeric value on a specified scale. It can be used by all stakeholders in the value chain for consistent measurement of automotive data signals quality.

The present invention provides a robust and effective solution to an entity or an organization by allowing to visualize the flow of automotive data signals from a source system to a sink system with different metric signals at each step and creating a mechanism for creating automotive signal quality marker (ASQM) for high quality automotive data signals by determining high value data parameters, inter-parameter correlation, data quality variation with trip duration, and frequency of data collection/distribution across datasets. The quality criterion thus developed is applied to data generated from a plurality of data sources. The ASQM may be calculated by converting the developed automotive data signals quality criterion into a numeric value on a specified scale. It can be used by all stakeholders in the value chain for consistent measurement of automotive data signals quality.

A system and method for detecting anomalies in very large datasets is disclosed. The method includes calculating statistics for data elements in a data set over a range of time periods. These statistics are arranged into a 2D array and analyzed using a machine learning algorithm to detect anomalous regions. The method also includes steps of analyzing time series of the data based on detected anomalous regions, correcting any errors in the datasets, and storing the corrected values in a separate database to maintain data integrity.

A system and method for detecting anomalies in very large datasets is disclosed. The method includes calculating statistics for data elements in a data set over a range of time periods. These statistics are arranged into a 2D array and analyzed using a machine learning algorithm to detect anomalous regions. The method also includes steps of analyzing time series of the data based on detected anomalous regions, correcting any errors in the datasets, and storing the corrected values in a separate database to maintain data integrity.

Systems, devices, computer-implemented methods, and/or computer program products that facilitate artificial intelligence (AI)-assisted curation of non-pharmaceutical intervention (NPI) data from heterogeneous data sources. In one example, a system can comprise a processor that executes computer executable components stored in memory. The computer executable components can comprise an extraction component and a change detection component. The extraction component can extract candidate non-pharmaceutical intervention (NPI) events from data associated with a defined disease. The change detection component can evaluate the candidate NPI events for inclusion in a dataset storing NPI events in a defined format.

Embodiments provide methods and systems for merchant data cleansing in payment network. Method performed by server system includes accessing electronic payment transaction records from transaction database. Each electronic payment transaction record includes merchant data fields. Method includes determining set of electronic payment transaction records with ambiguous merchant data fields having matching probability scores less than predetermined threshold value computed by probabilistic matching model and identifying at least one issue for non-matching of each of set of electronic payment transaction records. Method includes determining data model based on at least one issue of each of set of electronic payment transaction records. Data model is one of: phone-to-city model, payment aggregator model, and merchant name normalization model. Method includes updating set of electronic payment transaction records with unambiguous merchant data fields corresponding to ambiguous merchant data fields by applying data model to each of set of electronic payment transaction records.

Embodiments provide methods and systems for merchant data cleansing in payment network. Method performed by server system includes accessing electronic payment transaction records from transaction database. Each electronic payment transaction record includes merchant data fields. Method includes determining set of electronic payment transaction records with ambiguous merchant data fields having matching probability scores less than predetermined threshold value computed by probabilistic matching model and identifying at least one issue for non-matching of each of set of electronic payment transaction records. Method includes determining data model based on at least one issue of each of set of electronic payment transaction records. Data model is one of: phone-to-city model, payment aggregator model, and merchant name normalization model. Method includes updating set of electronic payment transaction records with unambiguous merchant data fields corresponding to ambiguous merchant data fields by applying data model to each of set of electronic payment transaction records.

A method for automatically detecting errors in at least one data entry in a database, the at least one data entry including an input string of characters that do not match at least one predefined string of characters. The method includes generating a first image map; generating at least one classification parameter by comparing the first image map to a second image map, the second image map based at least partially on the predefined string of characters; determining that the input string of characters correlates to the predefined string of characters; and modifying the at least one data entry to match the predefined string of characters in response to determining that the input string of characters correlates to the predefined string of characters. Various other methods and systems for automatically detecting errors in at least one data entry in a database are also disclosed.

A back-end application computer server may access a potential metadata entries data store containing a set of potential metadata entries, each entry including at least a data element name and a data element definition. A metadata collection system may be executed to automatically populate a metadata template based on the set of potential metadata entries. The system may update entries in the metadata template using a translation tool and validate the updated entries in the metadata template to ensure that required data elements are present. The system may also certify the validated entries load the set of certified metadata entries, including the certified data element names and certified data element definitions, into an enterprise metadata repository data store. Electronic messages may be exchanged to support at least one interactive user interface display associated with certification of the metadata template.

A back-end application computer server may access a potential metadata entries data store containing a set of potential metadata entries, each entry including at least a data element name and a data element definition. A metadata collection system may be executed to automatically populate a metadata template based on the set of potential metadata entries. The system may update entries in the metadata template using a translation tool and validate the updated entries in the metadata template to ensure that required data elements are present. The system may also certify the validated entries load the set of certified metadata entries, including the certified data element names and certified data element definitions, into an enterprise metadata repository data store. Electronic messages may be exchanged to support at least one interactive user interface display associated with certification of the metadata template.