One embodiment provides a method, including: receiving movement data describing physical movement of a person performing a predetermined action; generating, using a processor, classification of the movement data using a test application that predicts output of a wearable device, wherein the test application has been formed using previously collected data that describe the movement of a person performing the predetermined action; determining, using the processor, whether the movement data match the predetermined action in view of the classification; receiving output of a body-aware application that detects and responds to human movement; comparing, using the processor, the output of the body-aware application with the classification; and providing, using the processor, an indication of the comparing of the output of the body-aware application and the classification.

A computer-implemented method, system and computer program product for generating test cases for testing software. Log files are analyzed for indications of software defects resulting in software errors. For those log files that were found to indicate software errors, such log files are analyzed to determine if they contain personal data that needs to be anonymized based on an entropy score of the personal data. When the entropy score of the personal data is below a threshold value, anonymized variations of the personal data are generated. Trace logs are then created containing the anonymized variations of the personal data, which are returned to a software tester to create a test case for testing software using the created trace logs without having access to personal data. In this manner, the software tester may reproduce the software errors without having access to the personal data.

A system and method for remote testing of enterprise software applications (ESA) allows one or more testers to remotely access an ESA and remotely test the ESA. In at least one embodiment, the ESA resides in a testing platform that includes one more computers that are provisioned for testing. “Provisioning” a computer system (such as one or more servers) refers to preparing, configuring, and equipping the computer system to provide services to one or more users. In at least one embodiment, the computer system is provisioned to create an ESA operational environment in accordance with a virtual desktop infrastructure (VDI) template interacting with virtualization software.

A computer-implemented method of evaluating the performance of a full or partial autonomous vehicle (AV) stack in simulation, the method comprising: applying an optimization algorithm to a numerical performance function defined over a scenario space, wherein the numerical performance function quantifies the extent of success or failure of the AV stack as a numerical score, and the optimization algorithm searches the scenario space for a driving scenario in which the extent of failure of the AV stack is substantially maximized, wherein the optimization algorithm evaluates multiple driving scenarios in the search space over multiple iterations, by running a simulation of each driving scenario in a simulator, in order to provide perception inputs to the AV stack, and thereby generate at least one simulated agent trace and a simulated ego trace reflecting autonomous decisions taken in the AV stack in response to the simulated perception inputs, wherein later iterations of the multiple iterations are guided by the results of previous iterations of the multiple iterations, with the objective of finding the driving scenario for which the extent of failure of the AV stack is maximized.

Techniques for implementing rollback of infrastructure changes in an infrastructure orchestration service are described. In certain examples, an infrastructure orchestration service is disclosed that manages both provisioning and deploying of infrastructure assets within a cloud environment. The service receives a plan comprising a set of instructions associated with a set of infrastructure assets of an execution target and identifies a first state of the set of infrastructure assets. The service executes the set of instructions in the plan to achieve a second state for the set of infrastructure assets. Based in part on the executing, the service receives a trigger for rolling back the plan to restore the set of infrastructure assets in the plan to the first state and executes a rollback plan for the plan. The service then transmits a result associated with the execution of the rollback plan.

A transient input/output in progress state is established during processing of a testcase by a test infrastructure in a computing environment. The method includes obtaining the testcase for an object having one or more pages, and processing the testcase by the test infrastructure. Processing the testcase by the test infrastructure includes, for a page of the object, generating a delay in the processing of the testcase for the page of the object. The delay opens a transient input/output in progress state during which one or more test operations reference the page of the object.

The present disclosure is directed to systems, methods and devices for assisting with testing automated industrial process routines. The addition of a software automation object to a test execution user interface may be received. The software automation object may be added to the test execution user interface from a software object library comprising a plurality of software objects. Each of the software automation objects may include an automated control device layer, a human machine interface layer, and a testing layer. A request to initiate an operational test of the software automation object in the test execution user interface may be received. Upon receiving the request, the operational test may be executed, and test results for the operational test of the automation software object may be displayed on the test execution user interface.

Systems and methods for conducting a test on a third-party testing platform are provided. A networked system causes presentation of a setup user interface to a third-party user, whereby the setup user interface includes a field for indicating an attribute of a publication to be tested. The networked system receives, via the setup user interface, an indication of the attribute, a subject to be tested, and one or more test parameters. The networked system applies the attribute change to a first version of the publication to generate a second version of the publication. The first version is presented to a first subset of potential users and the second version is presented to a second subset of potential users. Interactions with both the first version and the second version are monitored and analyzed to determine results of the test. The results are then presented to the third-party user.

An objective-driven test case generation system includes an atomic test case module, a test data module, a tailoring module and a functional test case module. The atomic test case module generates a plurality of atomic test cases and stores the atomic test cases in an atomic test case library. The test data module receives a business model, determines one or more test steps from the input business model, and generates test data including the test steps. The tailoring module performs a linking operation to link the test steps included in the test data with one or more atomic test cases included in the atomic test case library to generate linked test case data. The functional test case module generates an objective-driven functional test case based on the linked test case data.

An automated video game testing framework and method includes communicatively coupling an application programming interface (API) to an agent in a video game, where the video game includes a plurality of in-game objects that are native to the video game. The agent is managed as an in-game object of the video game. A test script is executed to control the agent, via the API, to induce gameplay and interrogate a behavior of a test object. The test object is identified from the plurality of in-game objects based on a query that specifies an object attribute of the test object.