An autonomous vehicle uses a secondary vehicle control system to supplement a primary vehicle control system to perform a controlled stop if an adverse event is detected in the primary vehicle control system. The secondary vehicle control system may use a redundant lateral velocity determined by a different sensor from that used by the primary vehicle control system to determine lateral velocity for use in controlling the autonomous vehicle to perform the controlled stop.

A system and method for an on-demand shuttle, bus, or taxi service able to operate on private and public roads provides situational awareness and confidence displays. The shuttle may include ISO 26262 Level 4 or Level 5 functionality and can vary the route dynamically on-demand, and/or follow a predefined route or virtual rail. The shuttle is able to stop at any predetermined station along the route. The system allows passengers to request rides and interact with the system via a variety of interfaces, including without limitation a mobile device, desktop computer, or kiosks. Each shuttle preferably includes an in-vehicle controller, which preferably is an AI Supercomputer designed and optimized for autonomous vehicle functionality, with computer vision, deep learning, and real time ray tracing accelerators. An AI Dispatcher performs AI simulations to optimize system performance according to operator-specified system parameters.

An embodiment provides unmanned aerial vehicles (UAVs) for infrastructure surveillance and monitoring. One example includes monitoring power grid components such as high voltage power lines. The UAVs may coordinate, for example using swarm behavior, and be controlled via a platform system. Other embodiments are described and claimed.

One or more information maps are obtained by an agricultural work machine. The one or more information maps map one or more agricultural characteristic values at different geographic locations of a field. An in-situ sensor on the agricultural work machine senses an agricultural characteristic as the agricultural work machine moves through the field. A predictive map generator generates a predictive map that predicts a predictive agricultural characteristic at different locations in the field based on a relationship between the values in the one or more information maps and the agricultural characteristic sensed by the in-situ sensor. The predictive map can be output and used in automated machine control.

Disclosed are devices, systems and methods for capturing an image. In one aspect an electronic camera apparatus includes an image sensor with a plurality of pixel regions. The apparatus further includes an exposure controller. The exposure controller determines, for each of the plurality of pixel regions, a corresponding exposure duration and a corresponding exposure start time. Each pixel region begins to integrate incident light starting at the corresponding exposure start time and continues to integrate light for the corresponding exposure duration. In some example embodiments, at least two of the corresponding exposure durations or at least two of the corresponding exposure start times are different in the image.

An autonomous vehicle incorporating a multimodal multi-technique signal fusion system is described herein. The signal fusion system is configured to receive at least one sensor signal that is output by at least one sensor system (multimodal), such as at least one image sensor signal from at least one camera. The at least one sensor signal is provided to a plurality of object detector modules of different types (multi-technique), such as an absolute detector module and a relative activation detector module, that generate independent directives based on the at least one sensor signal. The independent directives are fused by a signal fusion module to output a fused directive for controlling the autonomous vehicle.

Disclosed is an object recognition method including: obtaining a first RGB image by using a camera; predicting at least one first region, in which an object is unrecognizable, in the first RGB image based on brightness information of the first RGB image; determining at least one second region, in which an object exists, from among the at least one first region, based on object information obtained through a dynamic vision sensor; obtaining an enhanced second RGB image by controlling photographic configuration information of the camera in relation to the at least one second region; and recognizing the object in the second RGB image.

A generation method of high-precision map for recognizing traffic lights is provided. The generation method comprised steps of: obtaining road test data comprising video data of traffic lights; marking the video data in order to obtain marked data of the traffic lights, the marked data comprising states of the traffic lights and traffic lights information; using the video data and the marked data to generate a recognition model of the traffic lights; and storing the recognition model and the traffic lights information in a high-precision map to generate a high-precision map for recognizing the traffic lights. Furthermore, a method and system for recognizing traffic lights using high-precision map are also provided. The recognition model is stored in the high-precision map, and cooperating with the high-precision map to effectively recognize the traffic lights.

Methods and systems for communicating between autonomous vehicles are described herein. Such communication may be performed for signaling, collision avoidance, path coordination, and/or autonomous control. A computing device may receive data for the same road segment from autonomous vehicles, including (i) an indication of a location within the road segment, and (ii) an indication of a condition of the road segment. The computing device may generate, from the data for the same road segment, an overall indication of the condition of the road segment, which may include a recommendation to vehicles approaching the road segment. Additionally, the computing device may receive a request from a computing device within a vehicle approaching the road segment to display vehicle data. The overall indication for the road segment may then be displayed on a user interface of the computing device.

A remote vehicle control system includes a vehicle mounted sensor system including a video camera system for producing video data and a distance mapping sensor system for producing distance map data. A data handling system is used to compress and transmit both the video and distance map data over a cellular network using feed forward correction. A virtual control system acts to receive the video and distance map data, while providing a user with a live video stream supported by distance map data. Based on user actions, control instructions can be sent to the vehicle mounted sensor system and the remote vehicle over the cellular network.