G05D1/2244

REMOTE CONTROL DEVICE

A remote control device for remotely controlling a ship propulsion device provided in a ship. The remote control device includes a remote control device main body including a main body case installed on an installation surface provided in the ship, and a remote control lever attached to the main body case, a display unit provided outside the main body case, and including a display case and a display provided in the display case, and a support arm that couples the display unit and the remote control device main body to each other, and that supports the display unit such that the display unit is disposed at a position separated from the remote control device main body.

User interface for mission generation of area-based operation by autonomous robots in a facility context

A system and a method are disclosed that generate for display to a remote operator a user interface comprising a map, the map comprising visual representations of a source area, a plurality of candidate robots, and a plurality of candidate destination areas. The system receives, via the user interface, a selection of a visual representation of a candidate robot of the plurality of candidate robots, and detects a drag-and-drop gesture within the user interface of the visual representation of the candidate robot being dragged-and-dropped to a visual representation of a candidate destination area of the plurality of candidate destination areas. Responsive to detecting the drag-and-drop gesture, the system generates a mission, where the mission causes the candidate robot to autonomously transport an object from the source area to the candidate destination area.

System, method and apparatus for object identification
11869249 · 2024-01-09 · ·

The present disclosure provides a system, a method and an apparatus for object identification, capable of solving the problem in the related art that a system for centralized control and management of unmanned vehicles may not be able to identify an object effectively. The system for object identification includes a sensing device, a control device and one or more unmanned vehicles. The control device is configured to determine an object not belonging to a predetermined category as an unknown object by performing object identification based on sensed data; mark the unknown object in the sensed data including the unknown object; determine an unmanned vehicle within a predetermined range from the unknown object; transmit the sensed data with the marked unknown object and an instruction to identify the unknown object to the determined unmanned vehicle; receive a feedback message from the unmanned vehicle, and when the feedback message carries information on an object category, save the information on the object category and mark a category of the unknown object as the saved object category.

Domestic robotic system
11865708 · 2024-01-09 · ·

A domestic robotic system includes a moveable robot having an image obtaining device for obtaining images of the exterior environment of the robot, and a processor programmed to detect a predetermined pattern within the obtained images. The processor and image obtaining device form at least part of a first navigation system for the robot which can determine a first estimate of at least one of the position and orientation of the robot. A second navigation system for the robot determines an alternative estimate of the at least one of the position and orientation of the robot. Calibration of the second navigation system can be performed using the first navigation system.

Delivery system with an access point and a method of accessing an access point of the delivery system
11873014 · 2024-01-16 · ·

An automated storage and retrieval system includes a storage grid for storage of storage containers and a delivery system for transport of said storage containers between a delivery port of the storage grid and an access point of the delivery system. The access point is adapted for handling of items held in the storage containers by a robotic operator or human operator. The delivery system includes a delivery rail system including at least a first set of parallel rails arranged in a horizontal plane (P1) and extending in a first direction (X), and at least a second set of parallel rails arranged in the horizontal plane (P1) and extending in a second direction (Y) which is orthogonal to the first direction (X), the first and second sets of rails together defining a delivery grid of delivery grid cells, the access point, and a remotely operated delivery vehicle comprising a motorized vehicle body and a container carrier provided above the motorized vehicle body for carrying a storage container of the storage containers. The delivery vehicle is moveable on the delivery grid of the delivery rail system. The delivery grid provides one or more delivery grid cells for the remotely operated delivery vehicle at the access point as well as a plurality of delivery grid cells adjacent the one or more delivery grid cells of the access point, such that there is more than one path to and/or from the access point for the remotely operated delivery vehicle via the plurality of delivery grid cells. The remotely operated delivery vehicle is arranged to transport the storage container from the delivery port of the storage grid across the delivery grid to the access point and return the storage container to the delivery port for storage within the storage grid. The access point is provided in a container accessing station, said station being arranged for separating the robotic or human operator from the delivery rail system and the remotely operated delivery vehicle. The container accessing station comprises a cabinet comprising walls and a top cover supported thereon, wherein the items held in the storage container carried by a remotely operated delivery vehicle at the access point is reachable through an opening in the top cover.

Sharing sensor data between multiple controllers to support vehicle operations

This disclosure presents an assisted driving vehicle system, including autonomous, semi-autonomous, and technology assisted vehicles, that can share sensor data among two or more controllers. A sensor can have one communication channel to a controller, thereby saving cabling and circuitry costs. The data from the sensor can be sent from one controller to another controller to enable redundancy and backup in case of a system failure. Sensor data from more than one sensor can be aggregated at one controller prior to the aggregated sensor data being communicated to another controller thereby saving bandwidth and reducing transmission times. The sharing of sensor data can be enabled through the use of a sensor data distributor, such as a converter, repeater, or a serializer/deserializer set located as part of the controller and communicatively coupled to another such device in another controller using a data interface communication channel.

Imaging device
11914387 · 2024-02-27 · ·

An imaging device, in particular a time-of-flight camera. In imaging device has at least one luminous element, which is designed to emit electromagnetic radiation, and at least one image acquisition element, which is set up to acquire reflected electromagnetic radiation. The imaging device includes at least one beam splitter unit, which is provided to image at least two different fields of view onto the image acquisition element.

Area-based operation by autonomous robots in a facility context
11958688 · 2024-04-16 · ·

A system and a method are disclosed that identifies a source area within a facility comprising a plurality of objects, and determines a destination area within the facility to which the plurality of objects are to be transported and unloaded. The system selects robots within the facility based a capability of the robots and/or a location of the robots within the facility. The system provides an instruction to the robots to transport the plurality of objects from the source area to the destination area. The robots are configured to autonomously select an object based on a position and location of the object within the source area, transport the selected object to a destination area along a route selected by the robot, and unload the selected object at a location within the destination area selected based on a number of objects yet to be unloaded within the destination area.

USER INTERFACE FOR REMOTE VEHICLE MONITORING

Techniques for providing a user interface for remote vehicle monitoring and/or control include presenting a digital representation of an environment and a vehicle as it traverses the environment on a first portion of a display and presenting on a second portion of the display a communication interface that is configured to provide communication with multiple people. The communication interface may enable communications between a remote operator and any number of occupants of the vehicle, other operators (e.g., other remote operators or in-vehicle operators), and/or people in an environment around the vehicle. The user interface may additionally include controls to adjust components of the vehicle, and the controls may be presented on a third portion of the display. Furthermore, the user interface may include a vehicle status interface that provides information associated with a current state of the vehicle.

System, method and apparatus for object identification
20190286907 · 2019-09-19 ·

The present disclosure provides a system, a method and an apparatus for object identification, capable of solving the problem in the related art that a system for centralized control and management of unmanned vehicles may not be able to identify an object effectively. The system for object identification includes a sensing device, a control device and one or more unmanned vehicles. The control device is configured to determine an object not belonging to a predetermined category as an unknown object by performing object identification based on sensed data; mark the unknown object in the sensed data including the unknown object; determine an unmanned vehicle within a predetermined range from the unknown object; transmit the sensed data with the marked unknown object and an instruction to identify the unknown object to the determined unmanned vehicle; receive a feedback message from the unmanned vehicle, and when the feedback message carries information on an object category, save the information on the object category and mark a category of the unknown object as the saved object category.