Validating actions in a digital assistant-based application is provided. The system identifies an application with a conversational interface. The system selects an action from an action repository and generates, via a natural language processor, a trigger phrase for input into the application. The system executes the application to process the trigger phrase to identify an action of the application. The system identifies a parameter used by the application to execute the action, and generates, based on the parameter and via execution of the conversational interface of the application, a first query responsive to the trigger phrase. The system generates a first response to the first query for input into the application. The system determines, based on execution of the application to process the first response, a state of the application. The system evaluates the state to determine an error code and provide a notification based on the error code.

Provided herein are systems and methods for creating, testing and providing digital guidance for use in an underlying computer application. In one exemplary implementation, a method includes using a browser extension to record steps of digital guidance content as the steps are created by a content author, automatically testing the content with the same browser and making the tested content available for playback. The testing may include receiving an execute testing command, fetching test case data from a server, executing a test case in the browser using the test case data, running tests on the test case in a background tab of the browser, recording passes and or failures of the tests, sending reports of the passes and failures to the server, sending a notification to the content author that the testing results are ready to view, and displaying the testing results in the dashboard.

Methods and systems for autonomous and semi-autonomous vehicle control, routing, and automatic feature adjustment are disclosed. Sensors associated with autonomous operation features may be utilized to search an area for missing persons, stolen vehicles, or similar persons or items of interest. Sensor data associated with the features may be automatically collected and analyzed to passively search for missing persons or vehicles without vehicle operator involvement. Search criteria may be determined by a remote server and communicated to a plurality of vehicles within a search area. In response to which, sensor data may be collected and analyzed by the vehicles. When sensor data generated by a vehicle matches the search criteria, the vehicle may communicate the information to the remote server.

A computer-implemented method of evaluating the performance of a target planner for an ego robot in a real or simulated scenario, the method comprising: receiving evaluation data for evaluating the performance of the target planner in the scenario, the evaluation data generated by applying the target planner at incrementing planning steps, in order to compute a series of ego plans that respond to changes in the scenario, the series of ego plans being implemented in the scenario to cause changes in an ego state the evaluation data comprising: the ego plan computed by the target planner at one of the planning steps, and a scenario state at a time instant of the scenario, wherein the evaluation data is used to evaluate the target planner by: computing a reference plan for said time instant based on the scenario state, the scenario state including the ego state at that time instant as caused by implementing one or more preceding ego plans of the series of ego plans computed by the target planner, and computing at least one evaluation score for comparing the ego plan with the reference plan.

While scheduled checkpoints are being taken of a cluster of active compute nodes distributively executing an application in parallel, a likelihood of failure of the active compute nodes is periodically and independently predicted. Responsive to the likelihood of failure of a given active compute node exceeding a threshold, the given active compute node is proactively migrated to a spare compute node of the cluster at a next scheduled checkpoint. Another spare compute node of the cluster can perform prediction and migration. Prediction can be based on both hardware events and software events regarding the active compute nodes.

A vehicle control device includes a verification management unit that executes old control software unit 112 representing an old version of control software and new control software unit 113 representing a new version of control software in sequence or in parallel, and an output verification unit that when an output value from old control software unit 112 and an output value from new control software unit 113 do not match, outputs information indicating the output values' not matching.

A testing system and method for testing application code against various failure scenarios. The testing system and method generate a test workflow including test source code implementing a series of actions that affect an application component and or an infrastructure component included in application code. The testing system and method execute the test workflow to determine the performance of the application code during one or more failure scenarios caused by the series of actions included in the test workflow. Performance data generated by the test code is analyzed by a performance analysis service or method to identify limitations of the application code and build resiliency patterns that address the limitations and improve the performance of the application code.

A method and apparatus for performing a user interface test by a middleware server including determining a state change of a portion of the user interface, receiving a test command indicative of a user interface functional test from a test interface, determining an auxiliary test associated with the test command, generating an altered test command requesting performance of the user interface functional test and the auxiliary test, transmitting the altered test command to the user interface, receiving a functional result from the user interface in response to the altered test command, generating an altered test result indicative of the functional result, and transmitting the altered test result to the test interface.

Methods, system, and non-transitory processor-readable storage medium for test coverage optimizing system are provided herein. An example method includes executing at least one test case on a system. A weighted average baseline metrics calculation module calculates a weighted average baseline metric for at least one test case using test related failures that occurred during the execution. A coverage imbalance module calculates a coverage imbalance associated with a test domain using the weighted average baseline metric, where the test domain comprises the at least one test case.

A method for testing an avionic computer having internal parameters of which only a subset of internal parameters is accessible to a test bench. The method includes connecting the avionic computer to the test bench, equipping the test bench with a test computer having software similar to software of the avionic computer, all of the internal parameters of which are accessible to the test bench, executing the software of the avionic computer in interaction with the test bench and executing the software of the test computer at the same time as the software of the avionic computer, and visualizing internal parameters belonging to the subset of internal parameters of the avionic computer and visualizing internal parameters of the test computer, corresponding to internal parameters of the avionic computer not belonging to the subset of internal parameters of the avionic computer, to check the conformity of operation of the software.