A robot assembly for safe operation in a manufacturing setting with humans including a sensor for detecting a human location and human movement is provided. A safety control module providing a boundary of a safety zone area that is associated with the human in a task oriented state that includes a largest possible area in which the human or an associated work object can extend when the human is standing in one location and performing the work task. The human movement and safety zone area location being used to develop a capture set area that includes at least one predictive future safety zone area location. Using the at least one predicted future safety zone area, establishing a travel path for moving the robot between locations without overlapping the capture set area.

A pedestrian tracking system includes: a buffer or a memory configured to store a trajectory sequence of a pedestrian; a step attention module and a control module. The step attention module iteratively performs a step attention process to predict states of the pedestrian. Each iteration of the step attention process includes the step attention module: learning the stored trajectory sequence to provide time-dependent hidden states, reshaping each of the time-dependent hidden states to provide two-dimensional tensors; condensing the two-dimensional tensors via convolutional networks to provide convolutional sequences; capturing global information of the convolutional sequences to output a set of trajectory patterns represented by a new sequence of tensors; learning time-related patterns in the new sequence and decoding the new sequence to provide one or more of the states of the pedestrian; and modifying the stored trajectory sequence to include the predicted one or more of the states of the pedestrian.

A method and a system determine a change of state of an autonomous device, such as an autonomous vehicle. A plurality of performance parameter values obtained by monitoring at least one performance parameter during the autonomous operation of the device is received. A performance quantity quantifying the quality of autonomous operation of the device, in particular the quality of driving of the autonomous vehicle, is determined based on the obtained performance parameter values and information associated with a flux of software and/or hardware related to the autonomous operation of the device. Further, a change of state value for the device is determined based on the performance quantity.

A method for performing automatic valet parking, which includes selecting a road scenario applicable to a roadway; notifying a driver to release manual control elements of a motor vehicle and to leave the motor vehicle; checking whether the control elements have been released and the driver has left the motor vehicle and, in this case, entering an EXPLORE mode in which the motor vehicle is slowly driven autonomously and searches for a free car space or a parking space using the vehicle's own environmental sensors, before the motor vehicle is placed in a parking position; and then to change from the EXPLORE mode to a PARKING mode in which the motor vehicle is parked in the car space or in the parking space from the parking position by means of the longitudinal and lateral controllers and using the environmental data previously obtained from the environmental sensors in the EXPLORE mode.

A processing apparatus includes a control unit. The control unit is configured to acquire facility information containing an advertisement or publicity on a facility located along a travel route that a vehicle is scheduled to travel or a facility located within a predetermined range from the travel route, and, while the vehicle is traveling along the travel route, process an image of a first facility associated with the facility information or an image of a second facility present around the first facility based on the facility information and display the image of the first facility or the image of the second facility on a display provided in the vehicle.

A vehicle includes a brake device; a storage configured to store a first setting value and a second setting value having a smaller magnitude than the first setting value; a communicator configured to receive an automatic parking signal; a detector configured to detect at least one of an object or whether the vehicle is in contact with the object; and a controller configured to control the brake device based on a detection result of the detector and the first setting value, and to control the brake device based on the detection result and the second setting value when the automatic parking signal is received.

A computer-implemented method for controlling a vehicle comprises: receiving tracking data associated with a surrounding environment of the vehicle; detecting, based upon the tracking data, an object in the surrounding environment of the vehicle; determining a location of the object; determining, based on navigation assistance data, whether the location of the object is at least partially within a classified area in the surrounding environment; and configuring a control system of the vehicle to: initiate, based upon determining that the location of the object is not at least partially within the classified area, a first collision avoidance response procedure for responding to the object; and initiate, based upon determining that the location of the object is at least partially within the classified area, a second collision avoidance response procedure for responding to the object, the second collision avoidance response procedure different from the first collision avoidance response procedure.

Aspects of the disclosure provide for controlling an autonomous vehicle using no block costs in space and time. For instance, a trajectory for the autonomous vehicle to traverse in order to follow a route to a destination may be generated. A set of no-block zones through which the trajectory traverses may be identified. A no-block zone may be region where the autonomous vehicle should not stop but can drive through in an autonomous driving mode. For each given no-block zone of the set, a penetration cost that increases towards a center of the no-block zone and decreases towards edges of the no-block zone may be determined. Whether the autonomous vehicle should follow the trajectory may be determined based on the penetration cost. An autonomous vehicle may be controlled in the autonomous driving mode according to the trajectory based on the determination of whether the autonomous vehicle should follow the trajectory.

Aspects of the disclosure relate to testing predictions of an autonomous vehicle relating to another vehicle or object in a roadway. For instance, one or more processors may plan to maneuver the autonomous vehicle to complete an action and predict that the other vehicle will take a responsive action. The autonomous vehicle is then maneuvered towards completing the action in a way that would allow the autonomous vehicle to cancel completing the action without causing a collision between the first vehicle and the second vehicle, and in order to indicate to the second vehicle or a driver of the second vehicle that the first vehicle is attempting to complete the action. Thereafter, when the first vehicle is determined to be able to take the action, the action is completed by controlling the first vehicle autonomously using the determination of whether the second vehicle begins to take the particular responsive action.

Systems and methods for curiosity development in an agent located in an uncertain environment are provided. In one embodiment, the system includes a goal state module, a curiosity module, and a planning module. The goal module is configured to calculate a goal state of a goal associated with the environment. The curiosity module is configured to determine an uncertainty value for the environment and calculate a curiosity reward based on the uncertainty value. The planning module is configured to update a motion plan based on the goal state and the curiosity reward.