Patent classifications
G06F11/3628
Automatically scalable system for serverless hyperparameter tuning
A scalable system and method for completing a model task using a serverless architecture is disclosed. The system may include a model optimizer having one or more memory units for storing instructions and one or more processors. The method may include receiving a request to complete a model task, and retrieving a stored model and a first hyperparameter based on the request. The method may include provisioning first computing resources to a development instance configured to train the retrieved model based on the first hyperparameter and the model task. The method may include receiving, from the development instance, a trained model and a performance metric. The method may include receiving, from a different development instance, a different performance metric associated with a different model, and terminating the development instance based on a determination that the termination condition is satisfied.
Robotic process automation simulation of environment access for application migration
The invention utilizes a plurality of robotic process automation (RPA) bots to generate data regarding production issues within applications. The RPA bots may simulate user access to the environment (i.e. user load) to predict possible issues or failures of the application within the particular environment. The RPA bots may further be used to identify the needs of an application when migrating the application from one environment to another. To this end, the bots may perform a dynamic simulation sequence for accessing applications, which may provide a realistic simulation of user load for an application within a certain environment. In this way, bots may be used to monitor and understand the complete runtime sequence and behavior of applications that would enable administrators to select the appropriate stack of modules of the destination infrastructure.
SYSTEMS AND METHODS FOR QUICKLY SEARCHING DATASETS BY INDEXING SYNTHETIC DATA GENERATING MODELS
Systems and methods for searching datasets and classifying datasets are disclosed. For example, a system may include one or more memory units storing instructions and one or more processors configured to execute the instructions to perform operations. The operations may include receiving a test dataset from a client device and generating a test data model output using a data model, based on the test dataset. The operations may include processing test data model output by implementing an encoding method, a factorizing method, and/or a vectorizing method. The operations may include retrieving a reference data model output from a dataset index, based on a reference dataset. The operations may include generating a similarity metric based on the reference data model output and the test data model output. The operations may include classifying the test dataset based on the similarity metric and transmitting, to the client device, information comprising the classification.
Systems and methods for hyperparameter tuning
A model optimizer is disclosed for managing training of models with automatic hyperparameter tuning. The model optimizer can perform a process including multiple steps. The steps can include receiving a model generation request, retrieving from a model storage a stored model and a stored hyperparameter value for the stored model, and provisioning computing resources with the stored model according to the stored hyperparameter value to generate a first trained model. The steps can further include provisioning the computing resources with the stored model according to a new hyperparameter value to generate a second trained model, determining a satisfaction of a termination condition, storing the second trained model and the new hyperparameter value in the model storage, and providing the second trained model in response to the model generation request.
Dataset connector and crawler to identify data lineage and segment data
Systems and methods for connecting datasets are disclosed. For example, a system may include a memory unit storing instructions and a processor configured to execute the instructions to perform operations. The operations may include receiving a plurality of datasets and a request to identify a cluster of connected datasets among the received plurality of datasets. The operations may include selecting a dataset. In some embodiments, the operations include identifying a data schema of the selected dataset and determining a statistical metric of the selected dataset. The operations may include identifying foreign key scores. The operations may include generating a plurality of edges between the datasets based on the foreign key scores, the data schema, and the statistical metric. The operations may include segmenting and returning datasets based on the plurality of edges.
Debugging a live streaming application
A connection can be made to a processing element of a remotely deployed and live streaming application executed by a first data processing system, the processing element containing at least one operator that processes at least one tuple. As the live streaming application is executed, without slowing or modifying data flow of the live streaming application execution to client devices, a copy of the tuple and a memory dump of state data for a state of the operator can be received, and the tuple can be tracked through a call graph. The state data can be loaded into a local instance of the operator loaded into a debugger. At least a portion of the call graph can be presented to a user, and a flow of the tuple through the call graph based on the state data for the operator can be indicated.
REAL-TIME SYNTHETICALLY GENERATED VIDEO FROM STILL FRAMES
Systems and methods for generating synthetic video are disclosed. For example, a system may include a memory unit and a processor configured to execute the instructions to perform operations. The operations may include receiving video data, normalizing image frames, generating difference images, and generating an image sequence generator model. The operations may include training an autoencoder model using difference images, the autoencoder comprising an encoder model and a decoder model. The operations may include identifying a seed image frame and generating a seed difference image from the seed image frame. The operations may include generating, by the image sequence generator model, synthetic difference images based on the seed difference image. In some aspects, the operations may include using the decoder model to synthetic normalized image frames from the synthetic difference images. The operations may include generating synthetic video by adding background to the synthetic normalized image frames.
SYSTEMS AND METHODS FOR REMOVING IDENTIFIABLE INFORMATION
Systems and methods for censoring text characters in text-based data are provided. In some embodiments, an artificial intelligence system may be configured to receive text-based data and store the text-based data in a database. The artificial intelligence system may be configured to receive a list of target pattern types identifying sensitive data and receive censorship rules for the target pattern types determining target pattern types requiring censorship. The artificial intelligence system may be configured to assemble a computer-based model related to a received target pattern type in the list of target pattern types. The artificial intelligence system may be configured to use a computer-based model to identify a target data pattern corresponding to the received target pattern type within the text-based data, identify target characters within the target data pattern, and to assign an identification token to the target characters.
SOURCE CODE FILE RETRIEVAL
According to one example, a method includes receiving a query from a client device, the query comprising a specified build identifier and a specified source code file name, determining, by a server device, a source code file from a plurality of archives using the specified build identifier and the specified source code file name, wherein determining the source code file comprises matching a longest shared prefix of the archive name associated with the specified build identifier and an archive name from a set of archive names having archived file names corresponding to the specified source code file name, and after the determining, responding to the query with the source code file.
SYSTEMS AND METHODS FOR MOTION CORRECTION IN SYNTHETIC IMAGES
Systems and methods for generating synthetic video are disclosed. For example, the system may include one or more memory units storing instructions and one or more processors configured to execute the instructions to perform operations. The operations may include generating a static background image and determining the location of a reference edge. The operations may include determining a perspective of an observation point. The operations may include generating synthetic difference images that include respective synthetic object movement edges. The operations may include determining a location of the respective synthetic object movement edge and generating adjusted difference images corresponding to the individual synthetic difference images. Adjusted difference images may be based on synthetic difference images, locations of the respective synthetic object movement edges, the perspective of the observation point, and the location of the reference edge. The operations may include generating texturized images based on the adjusted difference images.