Testing a computer software application by detecting an arrival of input data provided as input to a computer software application from a source external to the computer software application, modifying the detected input data to include test data configured to test the computer software application in accordance with a predefined test, thereby creating a modified version of the detected input data, and processing the modified version of the detected input data, thereby performing the predefined test on the computer software application using the test data.

A method is provided to evaluate impact of a change to code of a depended upon component of a system stored in a computer readable storage device, upon a dependent component of the system, the method comprising: identifying a dependency relationship between a first component stored in a computer readable storage device and a second component stored in the computer readable storage device; in response to a determination that the second component depends upon the first component, configuring a computer system to obtain a first property evaluation corresponding to the first component; and in response to obtaining the first property evaluation corresponding to the first component, configuring the computer system to associate the first property evaluation with the second component, and obtain a second property evaluation corresponding to the second component, wherein the second component is associated with the first property evaluation.

The techniques described herein provide software testing of a candidate software system. In some examples, an interceptor intercepts at least one production request to a production software system. The duplicating proxy service causes the at least one intercepted request to be processed by the candidate software system being validated and the production software system being used to validate the candidate software system. The duplicating proxy service may then compare and/or analyze at least one candidate response to the intercepted request from the candidate software system and at least one production response to the intercepted request from the production software system.

A stub can be loaded into a first browser environment of a browser application on a client machine, with the stub being loaded from a domain. The stub can execute to load an online application test into the first browser environment. Additionally, the test can execute in the first browser environment to conduct the test on an online application. For example, the test may be conducted from a second browser environment of the browser on the client machine. Performing the test can include loading one or more digital pages from the application into the second browser environment.

Disclosed is a method, a device, a system and/or a manufacture of computing hardware and software design testing auditability, including for critical control systems, functional safety, and autonomous vehicle component certification. In one embodiment, a system includes a test recording routine that defines a database relation associating a design version within a design dependency graph and a test version. The system includes a design audit interface that generates a first validation request to validate an isolation testing. An isolation validation engine determines that the design version has completed the isolation testing where each design script of the design fileset was executed in a discrete environment. In addition, a reproduction validation engine may also retrieve the design fileset and the runtime environment data, reassemble a workspace data, execute the test script, and compare the result data to a previous result data to validate reproducibility of the testing.

A system for testing changes to a website includes a hypervisor that instantiates a first virtual machine, from a first snapshot stored in a repository, as a first environment node in a test environment. The hypervisor applies scripts to configure the first virtual machine to test a first proposed webpage of the website. If the test is successful, then a second snapshot of the first virtual machine as configured is stored in the repository. The hypervisor may then instantiate a second virtual machine from the second snapshot, and configure the second virtual machine to test a second webpage of the website.

A method, system and computer program product for analytically selecting which tests are to be executed in a continuous delivery process. An analytics processing system constructs a code dependency tree to analyze the tests that are affected by changes in code after a new build is generated. After analyzing the code dependency tree, the system eliminates those tests in the code dependency tree that do not depend on the changed code. The system then analyzes the historical execution records for those tests that have not been eliminated for execution to obtain an execution rate and a failure rate for those tests. A score is generated for each of the tests from the code dependency tree that were not eliminated for execution based on the historical execution rate and failure rate of the test. Tests that have a score that exceeds a threshold are included for execution.

Particular embodiments provide a test system that allows the testing of different versions. The test system uses a repository of features that are included in the multiple versions of the application. When new features are added to the application, they may be added to the repository. When a test is performed, an application blueprint is used to build an application model using features from the repository. Then, a test case for the version can be run using the application model. By maintaining the repository of features and then dynamically building the application model for the version of the application, the testing of different versions of the application can be performed.

Test automation for a web page comprising specifying a number of tests for web page elements comprising specifying a test step for each of a number of web page elements on the web page. Each test step is stored as a metadata object containing a unique identifier for the web page, a unique identifier for the web page element to which the test step corresponds, and a required interaction for the web page element. A test step is selected to perform on a web page element, and the metadata for the element is extracted according to its unique identifier in the test step. An interpreter algorithm processes the metadata to determine what the web page element is, how best to identify the web page element, and commands to perform the required interaction and chooses a selector for the web page element. The test step is then executed.

Disclosed are various implementations of approaches for continuous delivery of management configurations. In some examples, a management configuration delivery workflow is identified. A management console user interface includes a graphical representation of the management configuration delivery workflow. The management configuration is retrieved from a source environment specified in the management configuration delivery workflow and transmitted to a specified destination environment.