Transport Robot and Method and System for Operating a Transport Robot in a Warehouse
20250189982 · 2025-06-12
Inventors
Cpc classification
G06Q10/08
PHYSICS
G05D1/644
PHYSICS
International classification
G05D1/644
PHYSICS
Abstract
A transport robot is used to carry out transport orders for transport of goods in a warehouse with a plurality of transport robots. The transport robot includes a communication interface configured to receive an environment model of the warehouse and a capability model of the plurality of transport robots. The environment model defines a plurality of key points of the warehouse and, for each key point, at least one neighboring key point. The capability model defines, for each of the key points of the environment model, movement sequence data for an automated movement to the at least one neighboring key point. The transport robot includes a control unit configured to carry out a transport order from a starting key point to a destination key point of the plurality of key points to automatically control movement of the transport robot based on the environment model and the capability model.
Claims
1. A transport robot to carry out transport orders for transport of goods in a warehouse with a plurality of transport robots, the transport robot comprising: a communication interface configured to receive an environment model of the warehouse and a capability model of the plurality of transport robots in the warehouse, wherein the environment model of the warehouse defines a plurality of key points of the warehouse and, for each key point, at least one neighboring key point, and wherein the capability model defines for each of the key points of the environment model, movement sequence data comprising at least one trajectory for an automated movement to the at least one neighboring key point; and a control unit to carry out a transport order from a starting key point to a destination key point of the plurality of key points, and configured to control movement of the transport robot on the basis of the environment model and first movement sequence data comprising a first trajectory and at least second movement sequence data comprising at least a second trajectory of the capability model, wherein the first movement sequence data comprising the first trajectory defines a movement from the starting key point to an intermediate key point neighboring the starting key point, and wherein the at least second movement sequence data comprising the at least one second trajectory defines a movement from the intermediate key point to a destination key point or a movement from the intermediate key point to an additional intermediate key point neighboring the intermediate key point.
2. The transport robot according to claim 1, wherein the control unit is further configured, after movement of the industrial truck from the starting key point to the intermediate key point on the basis of a first movement sequence data comprising the first trajectory, to determine a deviation of a current position or current pose from a specified position or specified pose of the transport robot relative to the intermediate key point and to vary the movement of the transport robot from the intermediate key point to the destination key point or the additional intermediate key point neighboring the intermediate key point on the basis of the second movement sequence data comprising the at least one second trajectory to counteract the deviation.
3. The transport robot according to claim 1, wherein, for each key point of the plurality of key points of the environment model, the movement sequence data comprising at least one trajectory of the capability model is based on at least one movement learned by imitation learning of a transport robot operated manually of the plurality of transport robots between the key point and the at least on neighboring key point.
4. The transport robot according to claim 1, wherein the control unit is further configured, by means of a cost function, to determine movement of the transport robot from the starting key point to the destination key point via the one or more intermediate key points lying between the starting key point and the destination key point.
5. The transport robot according to claim 1, wherein each key point of the plurality of key points has a marking, and wherein the transport robot further comprises a sensor unit, which is configured to detect the marking of a respective key point and to identify the respective key point on the basis of the detected marking.
6. The transport robot according to claim 5, wherein the control unit is configured, on the basis of the marking detected by the sensor unit of a respective key point, to determine a position of the transport robot relative to the respective key point.
7. The transport robot according to claim 5, wherein the marking is a visual marking, and wherein the sensor unit comprises a depth sensing camera for detection of the visual marking.
8. The transport robot according to claim 1, wherein the transport robot further comprises a drive unit which is configured to drive movement of the transport robot on the basis of movement control signals from the control unit.
9. The transport robot according to claim 1, wherein the transport robot is in the form of an industrial truck.
10. A system for operation of a plurality of transport robots in a warehouse, the system comprising: a plurality of transport robots according to claim 1; and a central device for the operation of the plurality of transport robots in the warehouse, wherein the central device is configured to make available to a transport robot of the plurality of transport robots the environment model of the warehouse and the capability model of the transport robots.
11. A method for operation of a transport robot to carry out transport orders for transport of goods in a warehouse with a plurality of transport robots, the method comprising: receiving an environment model of the warehouse and a capability model of the plurality of transport robots in the warehouse, wherein the environment model of the warehouse defines a plurality of key points of the warehouse and, for each key point, at least one neighboring key point, and wherein the capability model defines for each of the key points of the environment model movement sequence data comprising at least one trajectory for an automated movement to the at least one neighboring key point; and controlling movement of the transport robot to carry out a transport order from a starting key point to a destination key point of the plurality of key points on the basis of the environment model and first movement sequence data comprising a first trajectory, and at least second movement sequence data comprising at least a second trajectory of the capability model, wherein the first movement sequence data defines a movement from the starting key point to an intermediate key point neighboring the starting key point, and wherein the at least second movement sequence data comprising the at least second trajectory defines a movement from the intermediate key point to the destination key point or a movement from the intermediate key point to an additional intermediate key point neighboring the intermediate key point.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
[0026] The terms Fig., Figs., Figure, and Figures are used interchangeably in the specification to refer to the corresponding figures in the drawings.
[0027] Additional advantages and details of the invention are further explained by way of example on the basis of the exemplary embodiments illustrated in the accompanying schematic figures, in which:
[0028]
[0029]
[0030]
[0031]
[0032]
[0033]
[0034]
[0035]
[0036]
DESCRIPTION OF THE INVENTION
[0037]
[0038] As shown in
[0039] The transport robot 120a configured as an industrial truck 120 illustrated in
[0040] The transport robot 120a in the form of an industrial truck 120a can also comprise a sensor unit 130a, in particular an image acquisition unit 130a, which is configured to acquire, during the movement of the transport robot 120a, a plurality of images of the environment of the industrial truck 120a. The image acquisition unit 130a preferably comprises a camera 130a, in particular a depth sensing camera 130a. As indicated in
[0041] According to the invention, the transport robot 120a in the form of an industrial truck 120a further comprises a control unit 123 which can comprise, for example, one or more processors or micro-controllers with appropriate software which can control the transport robot 120a in the form of an industrial truck 120a in an at least semi-automated manner, as described in greater detail below.
[0042]
[0043] The system 100 comprises, in addition to the plurality of transport robots 120a,b, a central management device 110 such as a server 110, for example, which is configured to communicate with each transport robot 120a,b of the plurality of transport robots 120a,b, and to transmit to each of the plurality of transport robots 120a,b, for example, transport orders for the transport of goods 140 in the warehouse. For this purpose, for example, the transport robot 120a in the form of an industrial truck comprises a communication interface 126 which is configured to communicate with a corresponding communication interface 113 of the central management device 110 and with an external sensor unit 130b, such as, for example, a sensor unit 130b of the warehouse, for example via a wireless communication network 150, e.g. a wi-fi network or a mobile radio or cellular telephone network. The central management device 110 illustrated in
[0044] As shown in
[0045] As will be described in detail below with further reference to
[0046] As described in greater detail below, the environment model 200 of the warehouse defines a plurality of unambiguous key points 210a-c (hereinafter also referred to as semantic key points 210a-c or nodes 210a-c) of the warehouse in the form of a topological map.
[0047] As described in greater detail below, the capability model of the plurality of transport robots 120a,b defines or comprises for each of the key points 210a-h of the environment model 200, i.e. of the topological map 200, movement sequence data 220a,b, in particular at least one trajectory 220a,b, for an automated movement from the corresponding key point to the at least one neighboring key point or for the handling of pallets (automatic deposition or pickup). In other words, the capability model with the movement sequence data 220a,b, in particular trajectories 220a,b, for each key point 201a-c of the environment model 200 enables the transport robot 120a to connect neighboring key points of the environment model 200 with one another.
[0048] In one embodiment, the central management device 110 is configured to generate the environment model 200 of the warehouse and the capability model of the plurality of transport robots 120a,b configured as industrial trucks and to make it available to the transport robots 120a,b in the form of industrial trucks. In an additional embodiment, the plurality of transport robots can generate the environment model of the warehouse and the capability model in a distributed manner. In one embodiment, the environment model 200 of the warehouse and in particular the capability model of the plurality of transport robots 120a,b are based on imitation knowledge collected in the warehouse, which can advantageously be used in particular for the setup of a new transport robot in the warehouse.
[0049] According to the invention, the control unit 123 of the transport robot 120a is configured to carry out the transport order from a starting key point 220a to a destination key point 220c of the plurality of key points (210a-c), to automatically control the movement of the industrial truck 120a on the basis of the environment model 200 and first movement sequence data 220a, in particular of a first trajectory 220a, and at least second movement sequence data 220b, in particular of at least a second trajectory 220b, of the capability model, wherein the first movement sequence data 220a, in particular the first trajectory 220a, defines a movement from the starting key point 210a to an intermediate key point 210b neighboring the starting key point 210a and wherein the at least second movement sequence data 220b, in particular the at least second trajectory 220b, defines a movement from the intermediate key point 210b to the destination key point 210c or a movement from the intermediate key point 210b to an additional intermediate key point neighboring the intermediate key point 210b.
[0050] In the example illustrated in
[0051] For each key point of the plurality of key points 210a-h of the environment model 200, according to one embodiment the movement information 220a,b, in particular the at least one trajectory 220a,b of the capability model (which are linked with the corresponding key point) is based on at least one movement learned by imitation learning of an at least one transport robot operated at least partly manually, i.e. by an employee, of the plurality of transport robots 120a,b between the key point and the at least one neighboring key point. In other words, during the manual operation of the transport robots 120a,b in a warehouse, movement sequence data, in particular trajectories, can be recorded and collected to generate or to expand/update the capability model.
[0052] As will be apparent to the person skilled in the art, the environment model 200 and the capability model therefore define an annotated topological map of the warehouse with a plurality of key points 210a-h connected with one another, whereby by means of the capability model with each key point 210a-h movement sequence data, e.g. at least one trajectory 220a-c, of the capability model is concatenated for the movement to at least one neighboring key point. This movement sequence data 220a-c of the capability model can, as described above, define or comprise a trajectory for the description of necessary travel commands to reach the neighboring key points, as well as other types of movement sequence data that describe more complex movements, for example for the deposition or pickup of pallets, the loading of the transport robot etc.
[0053] As described above, the transport robot 120a further comprises a control unit 123 which is configured to carry out a transport order from a starting key point to a destination key point of the plurality of key points 210a-h, to automatically control the movement of the transport robot 120a on the basis of the environment model 200 and of the capability model. According to one embodiment of the invention, therefore, the expert knowledge or know-how required for the automatic operation of the transport robot 120a is transmitted to the transport robot 120a in the form of the environment model 200 and as imitation knowledge in the form of the capability model. The transport robot 120a in the form of an industrial truck 120a and the system 100 thereby provide a mapping of automated goods transport by imitation. The location and handling information required for this purpose can be generated concurrently by the observation of previously executed movements of a transport robot 120b configured in the form of an industrial truck (which can be identical or similar to the transport robot 120a) controlled manually (i.e. by a human being with expert knowledge, e.g. a warehouse employee), so that this information can be used for the generation or updating of the capability model. In this context concurrency describes an exploration phase of the plurality of transport robots 120a,b in the form of industrial trucks that automatically learn, by observation of the field of application during routine work, of all the movements executed and their geographic reference in the warehouse.
[0054] According to one embodiment of the invention, therefore, in the exploration phase, imitation knowledge in the form of environment knowledge can be learned automatically by observation of manual transports with the transport robots 120a,b in the form of industrial trucks. During the demonstration, for this purpose, as described above, the environment model 200 of the warehouse is generated in the form of a topological map 200, which is based on a plurality of semantic key points 210a-h of the warehouse. According to one embodiment, the semantic key points 210a-h may be considered for the transport of the goods 140 as locations of basic decisions in the warehouse in order to achieve the desired goal of automated transport orders. In addition to the information contained in the environment model 200, in addition, as described above, the capability model can also be learned, which is used for the concatenation between the previously observed semantic key points 210a-h.
[0055] In a subsequent exploitation phase, the imitation knowledge can be concatenated with the aid of AI-based handling planning with specific transport orders, so that the previously demonstrated manual transport operations can be carried out automatically. Potential disruptions in the execution of the learned movements caused by faults intrinsic to the system or dynamic obstacles can be compensated for, for example, by an adapted state-lattice-path planner. The localization required for the execution of automatic movements in the space can be based on a proximity-based localization approach which, for metrically continuous localization requirements utilizes the concatenation of the nodes 210a-h of the environment model 200 (i.e. of the key points 210a-h) via the capability model, and thus does not require a singular reference point, such as a coordinate point of origin in metric maps.
[0056] According to one embodiment, each key point of the plurality of key points 210a-h can have an artificial marking 230a,b, as described above in connection with
[0057] In one embodiment, the control unit 123 of the transport robot 120a in the form of an industrial truck is configured to determine, on the basis of the marking 230a,b detected by the sensor unit 130a of a respective key point the position, in particular the pose of the transport robot 120a in the form of an industrial truck relative to the respective key point.
[0058]
[0059] In the example illustrated in
[0060] As can be seen in particular in
[0061] According to one embodiment, the control unit 123 of the transport robot 120a is configured to counteract the integral error propagation illustrated in
[0062] According to one embodiment, the position of the starting key point 210a is used as a reference point for the realization of a metric localization for the individual mission. As soon as, in the further course of the automated movement of the transport robot 120a, expected nodes of the environment model 200 are reached, for example the intermediate key point 210b, these nodes can be used as correction variables on account of their known concatenated geometric relationship to the starting key point 210a. According to one embodiment, all relevant geometric relationships of the key points 220a-c can be taken from the topological map 200, i.e. from the environment model 200.
[0063] As described above, in the example illustrated in
[0064] According to one embodiment, a successful localization depends on the cumulative error (hereinafter designated e.sub.k) at the end of the movement along a trajectory of the capability model permitting a recognition of the next node. The ellipses 225b and 225c shown in
[0065] With the error e.sub.d determined in this manner, at the intermediate key point 201b at the time d, according to one embodiment, this error can be compensated for, to adjust the movement of the transport robot 120a back to a planned specified movement. On account of the non-holonomic properties of a plurality of transport robots, according to one embodiment, the compensation for the determined error is made by a compensation trajectory with an individual length. The path required for this purpose is represented in
[0066] As the transport robot 120a continues to move from the intermediate key point 210b to the destination key point 210c, an error can again occur (in particular on account of erroneous odometry signals), as soon as the transport robot 120a leaves the sensory node detection of the intermediate key point 210b. Until reaching the sensory perception of the destination key point 210c, the localization error, as during the movement from the starting key point 210a to the intermediate key point 210b, can now also increase during the current movement to the destination key point 210c. The error e can be recalculated as soon as the transport robot 120a enters the sensory detection range 225c of the destination key point 210c. For the overall movement from the starting key point 210a to the destination key point 210c, that means that the previously calculated error corrections make it possible to reach the next key point, if the transport robot 120a does not leave the maximum allowable error ellipse 225 (designated emax in
[0067] The generally derived calculation requirement for the determination of the error e.sub.k at the key point c and at the time k results from the concatenation of the nodes in the topological map 200 according to the following equation:
[0068] The index S in the above equation corresponds in this context corresponds to the starting point of the movement of the transport robot at the starting key point 210a, while c represents the next expected key point. The notation Sx.sub.k corresponds to the current odometry-supported, error-corrected pose of the transport robot 120a at the discrete time k in the starting coordinate system.
[0069] As the person skilled in the art knows, according to the invention the number of mission nodes, i.e. key points, plays no role in a successful localization. Only the relative pose between the neighboring nodes is necessary for the correction of the localization. In addition, the sensory detection of the nodes by the transport robot 120a must be possible to be able to calculate their relative pose.
[0070] The mapping of the environment of a warehouse according to the invention stored in the form of a topological map or environment model has the immediate advantage that the location information can be stored in the form of a discrete planning network. This discrete planning network represents by means of its edges all the potential connections that the transport robot 120a can execute. The topological map can also unite the environment model 200 and the (learned) capabilities for the concatenation of neighboring nodes. The topological maps therefore fundamentally expand the geometric-semantic approach of current map models by the integration of a capability model. The capability model is used as a metric link between the nodes of the environment model 200. As a result of the connection of a plurality of nodes, a kinematic chain is formed which interrupts the accumulating unknown localization error at the node points (semantic key points), because the positions of the sensed nodes dare environmentally invariant. Initially, two important deductions result from this observation.
[0071] Integral localization errors that result from external factors such as slip, malfunctioning sensor systems, digital losses etc. can be limited in their effects on the sensed nodes. Therefore, the annotated, topological maps described here minimize the risk of an invalid community map, as it is automatically learned and expanded by a fleet of transport robots. The map itself can thereby be replaced without further action.
[0072] The mappable geometric length of the trajectories of the capability model for the connection of the nodes is dependent only on the transport robot sensor system used and can further be expanded to include sensory post-processing steps (e.g. visual odometry).
[0073] In an additional possible configuration, to restrict the resulting incremental error, which increases with increasing distance from the passed node point, a relative supporting localization can be used, e.g. with the aid of methods of visual odometry as well as colored roadway markings, curb stones etc. The distance between the supporting points in a warehouse can therefore be increased.
[0074] An additional advantage results from the mapping of logical information of the nodes perceived visually if they have a direct mapping reference to the inventory management. In this case, the inventory management can work directly with the node information, so that the complex transfer of logical information of the inventory management into geometric information of the transport robot 120a,b is no longer necessary.
[0075]
[0076] The method 400 according to the invention can be carried out by means of the transport robot 120a in the form of an industrial truck. Therefore, additional embodiments of the method 400 according to the invention can be derived from the embodiments of the transport robot 120a according to the invention described above.