A vehicle routing system includes a vehicle routing and analytics (VRA) computing device, one or more databases, and one or more vehicles communicatively coupled to the VRA computing device. The VRA computing device is configured to generate an optimal route for a vehicle to travel that maximizes potential revenue for operation of the vehicle, the optimal route including a schedule of a plurality of tasks, and generate analytics associated with operation of the vehicle. The VRA computing device is further configured to provide a management hub software application accessible by vehicle users associated with vehicles, tasks sources, and other users.

Various technologies described herein pertain to generating an occupancy grid movie for utilization in motion planning for the autonomous vehicle. The occupancy grid movie can be generated for a given time and can include time-stepped occupancy grids for future times that are at predefined time intervals from the given time. The time-stepped occupancy grids include cells corresponding to regions in an environment surrounding the autonomous vehicle. Probabilities can be assigned to the cells specifying likelihoods that the regions corresponding to the cells are occupied at the future times. Moreover, cached query objects that respectively specify indices of cells of a grid occupied by a representation of an autonomous vehicle at corresponding orientations are described herein. An occupancy grid for the environment surrounding the autonomous vehicle can be queried to determine whether cells of the occupancy grid are occupied utilizing a cached query object from the cache query objects.

The embodiments of present disclosure herein address unresolved problem of cognitive navigation strategies for a telepresence robotic system. This includes giving instruction remotely over network to go to a point in an indoor space, to go an area, to go to an object. Also, human robot interaction to give and understand interaction is not integrated in a common telepresence framework. The embodiments herein provide a telepresence robotic system empowered with a smart navigation which is based on in situ intelligent visual semantic mapping of the live scene captured by a robot. It further presents an edge-centric software architecture of a teledrive comprising a speech recognition based HRI, a navigation module and a real-time WebRTC based communication framework that holds the entire telepresence robotic system together. Additionally, the disclosure provides a robot independent API calls via device driver ROS, making the offering hardware independent and capable of running in any robot.

A method for keypoint matching performed by a semantically aware keypoint matching model includes generating a semanticly segmented image from an image captured by a sensor of an agent, the semanticly segmented image associating a respective semantic label with each pixel of a group of pixels associated with the image. The method also includes generating a set of augmented keypoint descriptors by augmenting, for each keypoint of the set of keypoints associated with the image, a keypoint descriptor with semantic information associated with one or more pixels, of the semantically segmented image, corresponding to the keypoint. The method further includes controlling an action of the agent in accordance with identifying a target image having one or more first augmented keypoint descriptors that match one or more second augmented keypoint descriptors of the set of augmented keypoint descriptors.

Techniques are discussed for determining prediction probabilities of an object based on a top-down representation of an environment. Data representing objects in an environment can be captured. Aspects of the environment can be represented as map data. A multi-channel image representing a top-down view of object(s) in the environment can be generated based on the data representing the objects and map data. The multi-channel image can be used to train a machine learned model by minimizing an error between predictions from the machine learned model and a captured trajectory associated with the object. Once trained, the machine learned model can be used to generate prediction probabilities of objects in an environment, and the vehicle can be controlled based on such prediction probabilities.

A control system for controlling a movement of a carriage in which a load is housed includes a determination unit configured to determine whether or not an autonomous mobile robot is planned to move toward the carriage in a state in which the load is raised to a predetermined height or higher by a placement part, the autonomous mobile robot including the placement part having a changeable height and being configured to house the load placed on the placement part in the carriage, and a carriage control unit configured to control the carriage so that the carriage moves toward the autonomous mobile robot when it is determined that the autonomous mobile robot is planned to move toward the carriage in a state in which the load is raised to the predetermined height or higher by the placement part.

The present disclosure provides a general purpose operating system (GPROS) that shows particular usefulness in the robotics and automation fields. The operating system provides individual services and the combination and interconnections of such services using built-in service extensions, built-in completely configurable generic services, and ways to plug in additional service extensions to yield a comprehensive and cohesive framework for developing, configuring, assembling, constructing, deploying, and managing robotics and/or automation applications. The disclosure includes GPROS extensions and features directed to use as an autonomous vehicle operating system. The vehicle controlled by appropriate versions of the GPROS can include unmanned ground vehicle (UGV) applications such as a driverless or self-driving car. The vehicle can likewise or instead include an unmanned aerial vehicle (UAV) such as a helicopter or drone. In cases, the vehicle can include an unmanned underwater vehicle (UUV), such as a submarine or other submersible.

The technology relates controlling an autonomous vehicle through a multi-lane turn. In one example, data corresponding to a position of the autonomous vehicle in a lane of the multi-lane turn, a trajectory of the autonomous vehicle, and data corresponding to positions of objects in a vicinity of the autonomous vehicle may be received. A determination of whether the autonomous vehicle is positioned as a first vehicle in the lane or positioned behind another vehicle in the lane may be made based on a position of the autonomous vehicle in the lane relative to the positions of the objects. The trajectory of the autonomous vehicle through the lane may be adjusted based on whether the autonomous vehicle is positioned as a first vehicle in the lane or positioned behind another vehicle in the lane. The autonomous vehicle may be controlled based on the adjusted trajectory.

A system and method for providing multiple agents for decision making, trajectory planning, and control for autonomous vehicles are disclosed. A particular embodiment includes: partitioning a multiple agent autonomous vehicle control module for an autonomous vehicle into a plurality of subsystem agents, the plurality of subsystem agents including a deep computing vehicle control subsystem and a fast response vehicle control subsystem; receiving a task request from a vehicle subsystem; determining if the task request is appropriate for the deep computing vehicle control subsystem or the fast response vehicle control subsystem based on content of the task request or a context of the autonomous vehicle; dispatching the task request to the deep computing vehicle control subsystem or the fast response vehicle control subsystem based on the determination; causing execution of the deep computing vehicle control subsystem or the fast response vehicle control subsystem by use of a data processor to produce a vehicle control output; and providing the vehicle control output to a vehicle control subsystem of the autonomous vehicle.

A system for transportation includes a vehicle, a rider occupying the vehicle, and a hybrid neural network. The hybrid neural network includes a first neural network to process a sensor input corresponding to the rider to determine an emotional state of the rider, and a second neural network to optimize at least one operating parameter of the vehicle to improve the emotional state of the rider.