Non-line of sight (NLOS) remote control for machines is accomplished by a remote-control station with cellular connectivity to run multiple machines remotely. However, NLOS is expensive and may not work in areas with low cell tower coverage. Accordingly, the present disclosure pertains to providing on-machine remote control to operators of machines at a worksite. The on-machine remote control allows one machine to actively control another machine through connectivity between those two machines. For example, a tractor operator may use on-machine remote control to take control of a compactor, such that the compactor may be run using the tractor controls.

A method for sharing a point-of-interest across a plurality of video feeds from a plurality of optical imaging devices includes receiving an indication of the point-of-interest associated with a first video feed of the plurality of video feeds, the first video feed provided by a first optical imaging device of the plurality of optical imaging devices; determining a geo-location of an object associated with the point-of-interest; determining a position of a second optical imaging device relative to the determined geo-location of the point-of-interest; and overlaying the point-of-interest on a second video feed, the second video feed provided by the second optical imaging device.

Systems and techniques may be used to operate an aerial camera device. An example method may include using a mobile device for controlling an aerial device. The method may include receiving a sensor data, for example from the mobile device or the aerial device, establishing a centered position for the mobile device or the aerial device based on sensor information, and converting movement identified in sensor data to an instruction for movement of the aerial device. The instruction for movement may be sent to the aerial device, in an example.

A vehicle remote control system having a program running thereon, the vehicle remote control system including a storage device to store data regarding at least one vehicle, a remote control assembly connected to the storage device and the at least one vehicle to control the at least one vehicle corresponding to at least one component of the remote control assembly, and a display assembly to be worn by a user and connected to the remote control assembly to display a virtual reality image based on an exterior environment and an interior environment of the at least one vehicle thereon.

A method of controlling a payload supported by a carrier on a vehicle includes displaying, on a user interface of a terminal, at least one visual selector that causes a rotation control of the payload to be turned on or off, detecting, by a sensor of the terminal, an attitude of the terminal with respect to a plurality of rotational axes of the terminal, and displaying, on the user interface of the terminal, a plurality of attitude range indicators corresponding to a plurality of rotational axes of the payload. The rotation control controls the payload to rotate with respect to at least one of the plurality of rotational axes of the payload. Each of the plurality of attitude range indicators includes a visual indicator indicating the detected attitude of the terminal with respect to a corresponding one of the plurality of rotational axes of the terminal.

A remote operation system for a work machine includes, at a remote place of the work machine: an image data reception unit that receives a first image in a first imaging range and a second image in a second imaging range at least partially overlapping the first imaging range; and a display control unit that causes a display device to display the first image and the second image including an object whose state changes in an overlapping range between the first imaging range and the second imaging range.

A method for controlling flight includes displaying, in a real-time manner, a picture photographed and sent by a photographing device carried by an aerial vehicle; determining a no-clicking area in the picture based on a position of an obstacle or a no-fly zone; receiving a click operation of a user on the picture; and controlling a flight of the aerial vehicle based on the click operation. Controlling the flight of the aerial vehicle based on the click operation includes invalidating the click operation in response to determining a click location of the click operation being in the no-clicking area; and controlling the flight of the aerial vehicle based on a position of the click location in response to determining the click location being not in the no-clicking area.

A system 100 for remote assistance of an autonomous agent can include and/or interface with any or all of: a sensor suite 110, a computing system 120, a communication interface 130, and/or any other suitable components. The system can further optionally include a set of infrastructure devices 140, a teleoperator platform 150, and/or any other suitable components. The system 100 functions to enable information to be exchanged between an autonomous agent and a tele-assist. Additionally or alternatively, the system 100 can function to operate the autonomous agent (e.g., based on remote inputs received from a teleoperator, indirectly, etc.) and/or can perform any other suitable functions.

Systems and methods related to operating modes and video processing for mobile platforms are disclosed. In one example, a logic device of a mobile platform may receive, from a base station, a command comprising a selection of one of a plurality of operating modes for the mobile platform, where each operating mode is associated with a plurality of corresponding control operations. The logic device may execute the control operations associated with the selected operating mode in response to the command. A video processing device having a low latency pipeline may be implemented in the mobile platform to assist the mobile platform in conducting the operating modes such as by outputting real time video streaming and telemetry information for the mobile platform. Related devices and systems are also provided.

The relative position between a vehicle and an extension unit located outside the vehicle is detected, and a command touch operation for operating the vehicle with a remote operation device is set in accordance with the detected relative position. The touch operation of an operator is detected by a touch panel of the remote operation device, and a determination is made as to whether or not the detected touch operation is the command touch operation. When the touch operation is the command touch operation, the vehicle is controlled to execute autonomous travel control. The vehicle has an autonomous travel control function.