Multi robot system and method for intermodal container transport
11046515 · 2021-06-29
Assignee
Inventors
Cpc classification
G05B2219/31008
PHYSICS
B66F3/46
PERFORMING OPERATIONS; TRANSPORTING
B25J9/0084
PERFORMING OPERATIONS; TRANSPORTING
B25J5/00
PERFORMING OPERATIONS; TRANSPORTING
B25J9/162
PERFORMING OPERATIONS; TRANSPORTING
Y02P90/60
GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
Y02P90/02
GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
B65G67/603
PERFORMING OPERATIONS; TRANSPORTING
B66F9/06
PERFORMING OPERATIONS; TRANSPORTING
G05B2219/39146
PHYSICS
International classification
B66F3/46
PERFORMING OPERATIONS; TRANSPORTING
B25J5/00
PERFORMING OPERATIONS; TRANSPORTING
G05B19/418
PHYSICS
B66F9/06
PERFORMING OPERATIONS; TRANSPORTING
B65G63/00
PERFORMING OPERATIONS; TRANSPORTING
Abstract
A system and method for intermodal container transport that utilizes swarm intelligence and the autonomous locating, lifting, supporting and moving via robots working in conjunction. A port central command locates and releases robots to the container location and then transports the container to its destination.
Claims
1. A multi robot system for transport of an intermodal container positioned on a support surface and having corner castings, said system comprising: a central command server having container location information including a start location and a stop location; said server locates two or more autonomous robots for transport of said container along a transport path from said start location to said stop location; said two or more autonomous robots each capable of communicating information, including location information, with said server and with each other through a communications network; said server establishes communications with at least one of said two or more robots and sends said location information, through said network, to said at least one of said two or more robots whereby said at least one of said two or more robots establishes communications with the other of said two or more robots to synchronize and locate said container at said start location; and said two or more robots each engaging a corner castings of said container and lifting said container off of said support surface and transporting said container along said transport path whereby said two or more robots split said transport path into synchronized separate paths to said stop location.
2. The system as defined in claim 1 wherein said robot locks into an engaged corner casting.
3. The system as defined in claim 1 wherein said robot includes a base support for supporting said container during transport.
4. The system as defined in claim 1 wherein said robots include sensors to optimize obstacle avoidance during movement.
5. The system as defined in claim 1 wherein said robots utilize a pathfinding algorithm to optimize container transport movement.
6. The system as defined in claim 1 wherein said communications network includes a mesh wireless protocol whereby said server communicates with a nearest robot and said nearest robot communicates with any remaining robots.
7. A master swarm robot configured to collaborate with a central command server and at least a second swarm robot to transport a single intermodal container positioned on a support surface and having corner castings, said master robot comprising: a communications module for establishing communication with said server and said second swarm robot whereby said master robot receives location information, including a start location and a stop location and a transport path for said container therebetween, and sends said location information to a second robot; a drive module including a central processing unit for moving said robot over said support surface; a corner casting engagement member for engaging a corner casting of said container; and a lift mechanism for lifting said engagement member whereby when said engagement member is engaged with said engaged corner casting said container is lifted off of said support surface.
8. The robot as defined in claim 7 wherein said drive module enables 360 degree movement.
9. The robot as defined in claim 7 wherein said robot includes a base support for supporting said container during transport.
10. The robot as defined in claim 7 wherein said robot includes a LIDAR sensor.
11. The robot as defined in claim 7 wherein said robot includes an ultrasonic sensor.
12. The robot as defined in claim 7 wherein said communications module further establishes communication with a central command server.
13. The robot as defined in claim 7 wherein said robot locks into said engaged corner casting.
14. The robot as defined in claim 13 wherein said robot locks with a twist lock.
15. A multi robot method of transporting an intermodal container positioned on a support surface and having corner castings, said method comprising: establishing communications between a central command server and at least one autonomous robot through a communication network; establishing communications between said at least one robot and another robot through a communication network; sending container location information through said network from said server to said at least one robot; sending container location information through said network from said at least one robot to said another robot said two or more robots synchronizing and locating said container at a start location; said two or more robots engaging said container through said corner castings; said two or more robots lifting said container; and said two or more robots transporting said container along a transport path whereby said two or more robots split said transport path into synchronized separate paths to a stop location.
16. The method as defined in claim 15 further comprising said robots locking into said corner castings.
17. The method as defined in claim 16 further comprising said robots unlocking said container upon reaching said stop location.
18. The method as defined in claim 15 further comprising said robots supporting said container during transport.
19. The method as defined in claim 15 further comprising said robots lowering said container upon reaching said stop location.
20. The method as defined in claim 15 further comprising said robots disengaging said corner castings.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
(1) The present disclosure will be more fully understood by reference to the following detailed description of one or more preferred embodiments when read in conjunction with the accompanying drawings, in which like reference characters refer to like parts throughout the views and in which:
(2)
(3)
(4)
(5)
(6)
(7)
(8)
(9)
(10)
(11)
(12)
(13)
(14)
(15)
(16)
(17)
(18)
(19)
(20)
(21)
(22)
(23)
(24)
(25)
(26)
(27)
(28)
(29)
(30)
(31)
(32)
(33)
(34)
(35)
(36)
(37)
(38)
(39)
(40)
(41)
(42)
(43)
(44)
(45)
(46)
(47)
(48)
(49)
(50)
(51)
(52)
(53)
(54)
(55)
(56)
(57)
(58)
(59)
(60)
(61)
DESCRIPTION OF THE PREFERRED EMBODIMENTS
(62) The following description of the preferred embodiments is merely exemplary in nature and is in no way intended to limit the disclosure, its application or use. These exemplars are merely used to better describe the true spirit and scope of the present disclosure.
(63) The present multi robot system for intermodal container transport includes robots working together to locate, engage, lift and move shipping containers. However, it will be understood that the swarm intelligence system as disclosed herein is in no way limited to shipyard shipping containers and ports, nor with such ISO intermodal containers. Indeed, the system can be used for any type of container distribution and transport to further transport or storage (i.e. warehouse, distribution center, etc.).
(64) In any event, and in keeping with the shipyard and port example, a port is typically both extremely busy and congested. Any number of containers are stored and/or are being transported at any given time while at the same time any number of ships are delivering even more containers that also have to be transported and perhaps stored. Accordingly, each port has an accounting and positioning system for keeping track of each container. So, as each container is removed from the ship (via crane or otherwise) and is placed on the ground (or another container support surface) to await further transport, the port accounting and positioning system, whether fully automated, partially automated or otherwise determines when and how the new container is transported.
(65) The system of the present disclosure now makes possible the complete automation of, for example, container ports, rail yards and distribution centers. Essentially, the system optimizes port (for example) movement through the autonomous movement of containers via multiple robots. It is a heavy-payload multi-robotic system for moving international shipping containers. In the abstract, a system of robots work in conjunction to lift and transport a standard intermodal shipping container. Such robots may include wheels; a drive system/module controlled by a central processing unit; a lift mechanism; a locking mechanism to connect to a corner of the container; a communications system/module coupled to an external command center; and a communication system between robots.
(66) Turning now to the drawings, and in particular
(67) The enlarged view of
(68) When an ISO container, for example, is removed from the ship and initially positioned on the ground or other support surface of the port, it then needs to get transported to the appropriate destination. The present system can accomplish control of this transport of a container from a start (initial, etc.) position/location to a stop (final, storage, etc.) position/location in a number of ways. It can be done through the use of a central processor, either alone or in cooperation with the port location accounting and positioning system and with or without human operation. It can also be done through the robots doing all of the algorithms, the so-called distributed method instead of central processing method. In any event, both methods will be using the collective intelligence of multiple robots working together to transport the containers.
(69) In certain environments, traditional wireless based systems are ineffective due to, for example, obstructions (i.e. metal shipping containers), which deteriorates the quality of the wireless signals. As a result, extra latency and packet loss may occur, which can be detrimental to critical robotic systems. An embodiment of the present disclosure utilizes a mesh wireless system to increase signal resiliency in environments that would otherwise render wireless systems useless. A central command server communicates with the closest robot, which is then responsible for commanding other nearby robots to perform a common task. The robots directly communicate with each other through the so-called wireless mesh system, with server communications being done through the closest robot.
(70) More specifically and referring now to the logic flow diagram of
(71) Furthermore, and as illustrated in the exemplar network map 66 of the logic flow communications of
(72) Robots may be assigned to teams of two, three or four, for example, with one so-called “lead” robot per team. The lead robot will be responsible for talking with the server and instructing the other robots. The lead robot will be continuously and constantly communicating with the master server while it is powered on. The lead robot will send a status packet to the master server in each control cycle. The status packet will contain all necessary information that both the master server needs to know in order to assign jobs, as well as information that a port-side operator would need to see. The exact data to be transmitted is outlined in the implementation. During each control cycle, the other so-called “slave” robot(s) in a group will send a status packet to the lead robot containing all necessary information the lead robot will need to know. During each control cycle, the lead robot will send a status packet to the slave robot(s).
(73) The network map 66 includes a server 68 in wireless (WiFi or Bluetooth) communications with a central router 70 in wireless (WiFi or Bluetooth) communications with a wireless bridge 72 in wireless ((WiFi or Bluetooth) communications with a first robot 74, a second robot 76, a third robot 78 (if applicable) and a forth robot 80 (if applicable), etc. The wireless bridge 72 is in communications (i.e. Ethernet) with a mesh computer (e.g. LiDAR) 74 for vision as well as with a main CPU (e.g. Rasberry Pi) 76. The main CPU 76 is further in communications (i.e. Serial Bus) with a secondary processing unit (e.g. Arduino) 78 which is in communications (i.e. Digital) with a non-mesh computer vision (e.g. Ultra-Sonics) 80. The main CPU 76 is also further in communications (i.e. PWM) with the variable frequency drive motor controllers 82.
(74) Turning now to
(75) One of the goals of the present disclosure is to autonomously transport containers. As such, the robots need to target a part of the container to engage, lift, support and transport. In the present example of an ISO intermodal container the robot needs to locate and target a container corner casting. This algorithm is illustrated in the container corner find/lock protocol 102 of
(76) By way of example, robots are assigned 104 to a container and each navigate 106 thereto. During navigation it is determined 108 whether GPS and/or NAVIS (or the like) can improve navigation accuracy. If so, it is utilized to navigate 106. If not, then the robot arrives and scans 110 the container. LiDAR data is collected 112 by the robot and then data is shared 114 between all the robots. In order to find an edge each data point is connected to its nearest, second nearest and n.sup.th nearest point 116. All connections greater than x (variable) are pruned 118, independent meshes of points are identified 120 and an arbitrary point in the mesh is chosen 122. The point and next closest point to the previous one is appended to a linear regression 124. It is then determined whether successive appends result in a change in “r{circumflex over ( )}2>b” 126. If not then the robot scans again 110. If so, then an edge has been found 128. It is then determined whether all four edges of the container have been found 130 by the robots. If not, then an arbitrary point in the mesh is chosen 122 again. If so, then the robots move to rough corner locations 132. The robot then displaces 134 itself from the geometric corner of the container before entering the control loop feedback 136 steps. The robot uses stereo cameras, LiDAR and Ultrasonics to verify 138 locations and determines 140 whether the corner castings line up. If not, the PID loop is run and locations are verified 138. If so, PID is exited 142 and the robot moves forward to engage 144 the container with the twist-lock. The algorithm then waits for all robots to lock 146 and determines whether they have all locked in 148. If not, the system continues to wait 146. If so, then the container is lifted 150.
(77) Referring now to
(78) The twisklock and holder of the lift assembly 12 will now be described as shown in
(79) When the container is properly located and locked by four robots, the robots lift the container together, move their supports under each corner and then lower the container onto their supports. Before the robots then move the container as one, the horizontal movement of the lift system on the robot chassis is preferably locked. That said, and referring now to
(80) Turning back to the lift system assembly 12,
(81)
(82) Similarly,
(83)
(84) It will be appreciated that a single robot may include more than one engagement and/or lift mechanism. In other words, and for example, while the Figures have thus far illustrated robots with a single twist lock, they may include two twist locks. Accordingly, one larger robot may be capable of engaging and locking and lifting two corners of the intermodal container. In such embodiments, the container can be transported with two, three or four robots.
(85) In any event, after the robots have the subject container locked, lifted and supported, they are ready to collaborate with one another and transport it to the determined destination.
(86) Mapping is continuous with robot power and will be accomplished both when the robots are moving a container together and when they are traveling individually. When moving a container, each group of robots share their own local map (e.g. a 2D map of their immediate surroundings). The robots rely on this map to avoid unexpected obstacles that the port-side software would not report. The lead robot receives a 2D point map from each slave robot with each control cycle. During each control cycle, the lead robot will consolidate and average the four (for example) individual robot maps into one 2D map. The lead robot will then make decisions based on this averaged map such as instructing the robot “team” to stop when a person walks by. When moving individually, every robot will generate a local map when moving individually and the robot will make decisions based on this local map generated from sensor data.
(87) It will be understood that alternate embodiments of robots and features/elements thereof may be used with the system for intermodal container transport. For example,
(88) The drive system of the robot of
(89) An alternate embodiment of the twist lock 260 assembly (e.g. modified Sea Box SB 241 twist lock and the like) is illustrated in
(90) The lift mechanism 274 that can be used with the twist lock assembly 260 of
(91) The lifting procedures of the robots of the present disclosure are exemplified in the simplistic flow diagram 278 of
(92) An alternate embodiment of the swerve assembly 320 is shown in
(93) Another alternate embodiment of the swerve assembly 328 is shown in
(94) The overall electrical layout of an embodiment of a robot of the present disclosure will be shown and described via
(95) The other split path from the terminal blocks is used to power the Jetson TX2 (for example) 348. This power is sent through a 5 Amp circuit breaker 350 and manual toggle switch 352. Next, the voltage is stepped to 19 volts using a transformer 354 before it is converted into a single line via a barrel-jack breakout 356 and then sent to the Jetson TX2 348.
(96) From the Jetson TX2 348, virtually all the hardware receives their commands. The LIDAR is connected to the Jetson TX2 348 in order to increase the amount of hardware that can be connected. This may include a camera 360 for vision processing, a XBEE system 362 for communications, and the swerve modules—all connected by USB ports. The swerve module includes the Gaggeteer 364 and HERO board 366. The HERO board 366 send commands to the Talon SRX system via CAN protocol.
(97) The foregoing detailed description has been given for clearness of understanding only and no unnecessary limitations should be understood therefrom. Accordingly, while one or more particular embodiments of the disclosure have been shown and described, it will be apparent to those skilled in the art that changes and modifications may be made therein without departing from the invention if its broader aspects, and, therefore, the aim in the appended claims is to cover all such changes and modifications as fall within the true spirit and scope of the present disclosure.