Various embodiments relate generally to autonomous vehicles and associated mechanical, electrical and electronic hardware, computer software and systems, and wired and wireless network communications to provide an autonomous vehicle fleet as a service. In particular, a method may include receiving first sensor data from a first sensor disposed on a vehicle, the first sensor data associated with a first sensor modality, and receiving second sensor data from a second sensor disposed on the vehicle, the second sensor data associated with a second sensor modality different than the first sensor modality. The method may further include generating fused sensor data representing at least a portion of the first sensor data and the second sensor data, generating a trajectory for the vehicle based in part on the fused sensor data, and controlling the vehicle based in part on the trajectory.

A vehicle may include an authority tracker to grant and/or limit authority to provide guidance to the vehicle. The authority tracker may store a state in a memory identifying an actor that currently has the authority. An actor requesting to have authority to provide guidance to the vehicle may transmit a control message to the authority tracker which may, in turn, authorize or deny the request based on a policy. The authority tracker may periodically, and/or in response to a request, broadcast a state message identifying the actor that currently has authority, as recorded in the memory.

A mobile robot includes a processor connected to a memory and a wireless network circuit, for executing routines stored in the memory and commands generated by the routines and received via the wireless network circuit. The processor drives the mobile robot to a multiplicity of accessible two dimensional locations within a household, and commands an end effector, including at least one motorized actuator, to perform mechanical work in the household. A plurality of routines include a first routine which monitors a wireless local network and detects a presence of a network entity on the wireless local network, a second routine which receives a signal from a sensor detecting an action state of one of the network entities, the action state changeable between waiting and active, and a third routine which commands the end effector to change state of performing mechanical work based on the presence and on the action state.

A mobile robot includes a processor connected to a memory and a wireless network circuit, for executing routines stored in the memory and commands generated by the routines and received via the wireless network circuit. The processor drives the mobile robot to a multiplicity of accessible two dimensional locations within a household, and commands an end effector, including at least one motorized actuator, to perform mechanical work in the household. A plurality of routines include a first routine which monitors a wireless local network and detects a presence of a network entity on the wireless local network, a second routine which receives a signal from a sensor detecting an action state of one of the network entities, the action state changeable between waiting and active, and a third routine which commands the end effector to change state of performing mechanical work based on the presence and on the action state.

An AI based system and method for managing heterogeneous network-agnostic swarm of robots is disclosed. The method includes receiving a set of commands from a human machine interface associated with one or more electronic devices, determining one or more robotic capabilities associated with autonomous robot and capturing one or more positional parameters by using one or more sensors. The method includes broadcasting the one or more robotic capabilities and the one or more positional parameters to each of the one or more autonomous robots and determining one or more situational parameters associated with the one or more autonomous robots. Furthermore, the method includes detecting one or more targets and allocating the one or more tasks and the detected one or more targets among the one or more autonomous robots.

A work screen display system including a position information obtaining unit for obtaining position information on a work vehicle based on positioning correction information supplied from a first reference station; a region shape determination unit for determining a shape of a specific region where the work vehicle performs autonomous travel, based on positioning correction information supplied from a second reference station; and a display control unit for displaying, on a display unit, a specific region indication section indicating the specific region determined by the region shape determination unit. The display control unit displays the specific region indication section in a display mode that varies between a case where the first and second reference stations are identical and a case where the first and second reference stations are not identical.

A method computer system and computer program product are provided for performing remote operations by enhanced telepresence. A set of physical robots in a three-dimensional (3D) space in which is contained a physical object. The set of physical robots includes cameras separated by one or more distances between the cameras. Using at least two of the cameras, images are captured, and a parallax measurement is generated. A 3D virtual reality environment is generated that includes a space representation of the 3D space and an object virtual representation of the physical object. The robot virtual representation includes a point-of-view located about on the set of physical robots. The 3D virtual reality environment is projected using a virtual reality projector.

A control device generates a first image in which, together with an object in the real world appearing in an image captured by a camera of a robot, a virtual object appears and which presents an exterior appearance of the virtual object while the position of the camera of the robot is set as a view-point. An HMD displays the first image generated by the control device. In a case in which the position of the HMD in the height direction changes, the control device generates a second image from which the object in the real world is deleted and which presents the exterior appearance of the virtual object viewed from a new view-point according to the change in the position of the HMD in the height direction. The HMD displays the second image in place of the first image.

A mobile robot includes a processor connected to a memory and a wireless network circuit, for executing routines stored in the memory and commands generated by the routines and received via the wireless network circuit. The processor drives the mobile robot to a multiplicity of accessible two dimensional locations within a household, and commands an end effector, including at least one motorized actuator, to perform mechanical work in the household. A plurality of routines include a first routine which monitors a wireless local network and detects a presence of a network entity on the wireless local network, a second routine which receives a signal from a sensor detecting an action state of one of the network entities, the action state changeable between waiting and active, and a third routine which commands the end effector to change state of performing mechanical work based on the presence and on the action state.

A control method includes controlling a virtual object to perform an action, the virtual object being constructed based on a physical object; determining a target instruction based on the action performed by the virtual object; and sending the target instruction to the physical object to cause the physical object to perform an action.