G05D1/224

Systems and methods of detecting intent of spatial control

Systems and methods of manipulating/controlling robots. In many scenarios, data collected by a sensor (connected to a robot) may not have very high precision (e.g., a regular commercial/inexpensive sensor) or may be subjected to dynamic environmental changes. Thus, the data collected by the sensor may not indicate the parameter captured by the sensor with high accuracy. The present robotic control system is directed at such scenarios. In some embodiments, the disclosed embodiments can be used for computing a sliding velocity limit boundary for a spatial controller. In some embodiments, the disclosed embodiments can be used for teleoperation of a vehicle located in the field of view of a camera.

Visual overlays for indicating stopping distances of remote controlled machines
11885102 · 2024-01-30 · ·

A controller may receive, from a sensor device, machine velocity data indicating a velocity of a machine controlled by a remote control device. The controller may determine, based on the machine velocity data, a distance to be traveled by the machine until the machine stops traveling after a communication, between the machine and the remote control device, is interrupted. The controller may generate, based on the distance, an overlay to indicate the distance. The controller may provide the overlay, for display, with a video feed of an environment surrounding the machine.

Vehicle remote control method and vehicle remote control device

The relative position between a vehicle and an extension unit located outside the vehicle is detected, and a command touch operation for operating the vehicle with a remote operation device is set in accordance with the detected relative position. The touch operation of an operator is detected by a touch panel of the remote operation device, and a determination is made as to whether or not the detected touch operation is the command touch operation. When the touch operation is the command touch operation, the vehicle is controlled to execute autonomous travel control. The vehicle has an autonomous travel control function.

Remote operation system and remote operation server

Provided is a system which can avoid instability of an operating state of a working machine, when switching a remote operation actor of the working machine. In a case where a state of one or both of a working machine 40 or a first operator is a specified state when the working machine 40 is remotely operated through a first remote operation apparatus 10, a first notification corresponding to the specified state is transmitted to a remote operation server 30. In the remote operation server 30, a second remote operation apparatus 20 which is appropriate in view of content of the first notification is selected as the remote operation actor of the working machine 40.

Image-Based Method for Simplifying a Vehicle-External Takeover of Control of a Motor Vehicle, Assistance Device, and Motor Vehicle
20240103548 · 2024-03-28 ·

A method is provided for simplifying a takeover of control of a motor vehicle by a vehicle-external operator. In the method, images of the surroundings of the vehicle are captured from the vehicle and semantically segmented. Errors in a corresponding segmentation model are predicted on the basis of at least one such image each. If a corresponding error prediction triggering a request for the takeover of control is made, an image-based visualization is automatically generated in which exactly one region corresponding to the error prediction is visually highlighted. The request and the visualization are then sent to the vehicle-external operator.

DEVICE AND METHOD FOR INSPECTING AN INDUSTRIAL VEHICLE

Method for inspecting an industrial equipment in an operating space, including the following steps: receiving image data, detected by a measurement device and representing an image including at least one component of the industrial equipment; processing the image data by means of machine vision algorithms to identify a control parameter; processing image data and determining a dimensional measurement, using machine vision algorithms, corresponding to the control parameter identified; formulating and sending a read request to a memory, based on the control parameter identified; sending an allowable maintenance value, representing an allowable value of the control parameter identified; comparing between the allowable maintenance value and the dimensional measurement; generating a diagnosis, based on the comparison between the allowable maintenance value and the dimensional measurement.

INFORMATION GENERATION METHOD, INFORMATION GENERATION DEVICE, AND RECORDING MEDIUM
20240103541 · 2024-03-28 ·

An information generation method is performed by an information generation device which generates information for a learning model that infers whether a mobile object is movable in a predetermined region. The information generation method includes: obtaining at least (i) first information and (ii) second information when the mobile object moves in a first region, the first information being obtained from a sensor provided in the mobile object, the second information relating to movement of the mobile object; inferring whether the mobile object is movable in the first region according to the second information; and generating fourth information for a learning model, the fourth information associating the first information, the second information, and third information with one another, the third information indicating an inference result which is obtained in the inferring.

Remotely controllable aeronautical ordnance
11940251 · 2024-03-26 · ·

An ordnance for air-borne delivery to a target under remotely controlled in-flight navigation. In one embodiment, self-powered aerial ordnance includes upper and lower cases. A plurality of co-axial, deployable blades is powered by a motor positioned in the upper case. When deployed, the blades are rotatable about the upper case to impart thrust and bring the vehicle to a first altitude above a target position. An explosive material and a camera are positioned in a lower case which is attached to the upper case. The camera generates a view along the ground plane and above the target when the ordinance is in flight. When the vehicle is deployed it is remotely controllable to deliver the vehicle to the target to detonate the explosive at the target. The ordnance may drop directly on a target as a bomb does.

Forklift-truck remote operation system

A forklift-truck remote operation system includes a forklift truck and a remote operation device. The forklift-truck remote operation system further includes: a camera mounted to the forklift truck and configured to capture an image of an area around the forklift truck; a display disposed in the remote operation device and configured to display the image captured by the camera; a pallet detector configured to perform image recognition processing of the image captured by the camera and detect a plurality of pallets; a display controller configured to control the display to display the image captured by the camera with an indication for pallet selection from the pallets detected by the pallet detector; and a travel controller configured to control the forklift truck to move to a position of the selected pallet.

CONTROL METHOD AND CONTROL SYSTEM
20240094745 · 2024-03-21 ·

A control method includes the following. First information indicating a group control level is determined based on operation skills of operators who each perform remote monitoring or remote operation on a moving body. Second information indicating an attribute-dependent control level is determined based on attribute information on the operators. Third information indicating individual control levels of the operators is determined based on the first and second information. Moving bodies present within a predetermined range from a predetermined notification device are identified. Fourth information indicating a device control level is determined based on the third information determined for operators of the moving bodies identified. A detail of notification to be output from the predetermined notification device is determined based on the fourth information. A control command for notifying of the detail is output.