METHOD AND SYSTEM FOR REDUCING LATENCY BETWEEN AN AUTOMATED VEHICLE AND A REMOTE TERMINAL

Abstract

The present invention relates to a method and system for communicating information between an automated vehicle (20) and a remote terminal (10), comprising providing (102) information (12, 22) to be communicated between the automated vehicle and the remote terminal, packaging (104) said information as a sequence (30) of N data packets (P), wherein each data packet is provided with a unique data packet number (6) ranging from 1 to N indicating the position of each data packet in the sequence of data packets, transmitting (106) the sequence of N data packets via at least a first (A) and a second (B) communications link between the automated vehicle and the remote terminal, assembling (108) a complete sequence of N unique data packets after each unique data packet has been successfully communicated via either said at least a first or a second communications link, wherein the sequence of N data packets is transmitted via said at least a first communications link in an order of ascending data packet numbers and via said at least a second communications link in an order of descending data packet numbers.

Claims

1. A computer-implemented method for communicating information between an automated vehicle and a remote terminal, comprising the steps of: providing information to be communicated between the automated vehicle and the remote terminal; packaging said information by means of a packaging unit as a sequence of N data packets, wherein each data packet is provided with a unique data packet number ranging from 1 to N indicating the position of each data packet in the sequence of data packets; transmitting the sequence of N data packets via a first communication link between the automated vehicle and the remote terminal and also via at least a second communication link between the automated vehicle and the remote terminal, said first and at least second communication link established by means of an automated vehicle communication unit and a remote terminal communication unit; assembling a complete sequence of N unique data packets by means of an assembling unit after each unique data packet has been successfully communicated via either said at least a first or a second communication link, wherein the sequence of N data packets is transmitted via said first communication link in an order of ascending data packet numbers and via said at least a second communication link in an order of descending data packet numbers.

2. The method according to claim 1, wherein the unique data packet number is provided in a header of the data packet.

3. The method according to claim 2, wherein the step of packaging the information in a sequence of N data packets comprises a step of using a protocol defining the data payload and a header further comprising any combination of the following fields: protocol identifier, frame index, frame buffer, buffer offset.

4. The method according to claim 1, wherein at least one of the first and second communications link is a wireless communication link established over a cellular network, such as 4G/LTE or 5G.

5. The method according to claim 1, wherein said provided information to be communicated includes sensory data of the surroundings of the automated vehicle, and the step of providing information to be communicated comprises a step of capturing sensory data of the surroundings of the automated vehicle by means of sensors of the automated vehicle.

6. The method according to claim 5, further comprising a step of rendering a representation of the surroundings of the automated vehicle based on the captured sensory data communicated from the automated vehicle to the remote terminal, and displaying the rendered representation by means of at least one remote terminal display or a remote terminal VR headset.

7. The method according to claim 1, wherein said provided information to be communicated includes driving instructions for the automated vehicle, and the step of providing information to be communicated comprises a step of operating the remote terminal for providing said driving instructions for the automated vehicle.

8. The method according to claim 7, wherein the displayed rendered representation presents a field of view in a driving direction of the automated vehicle having a horizontal field of view that extends between 90 degrees and 360 degrees and having a vertical field of view that extends between 45 degrees and 180 degrees.

9. The method according to claim 6, further comprising a step of driving the automated vehicle by means of the remote terminal.

10. The method according to any of claim 6, wherein the displayed rendered representation presents augmented reality features for assisting a user operating the automated vehicle from the remote terminal.

11. The method according to any of claim 6, comprising the steps of communicating a request for further driving instructions between the automated vehicle and the remote terminal, and communicating further driving instructions between the automated vehicle and the remote terminal based on the communicated request.

12. The method according to claim 1, comprising the step of monitoring at least one automated vehicle by means of a single remote terminal, and assuming control of one of the at least one automated vehicle if said one automated vehicle is identified to require further driving assistance.

13. An automated vehicle comprising communications means for communicating information between the automated vehicle and a remote terminal using the method according to any of claim 1.

14. A remote terminal comprising communication means for communicating information between the remote terminal and an automated vehicle using the method according to any of claim 1.

15. An automated vehicle control system comprising the automated vehicle comprising communications means for communicating information between the automated vehicle and the remote terminal, and the remote terminal comprising communication means for communicating information between the remote terminal and an automated vehicle, the automated vehicle control system for communicating information in either direction between the automated vehicle and remote terminal according to the method of claim 1.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

[0025] The invention will in the following be described in more detail with reference to the enclosed drawings, wherein:

[0026] FIG. 1 shows a schematic view of a system according to an embodiment of the present invention;

[0027] FIG. 2 shows a perspective view of a remote terminal according to an embodiment of the present invention;

[0028] FIG. 3 shows a block diagram of a system according to an embodiment of the present invention;

[0029] FIG. 4 shows a block diagram of a system according to an embodiment of the present invention;

[0030] FIG. 5 shows a block diagram of a system according to an embodiment of the present invention;

[0031] FIG. 6 shows a block diagram of a system according to an embodiment of the present invention;

[0032] FIG. 7 shows a data packet according to an embodiment of the present invention; and

[0033] FIG. 8 shows a flow chart of a method according to an embodiment of the present invention.

DESCRIPTION OF EMBODIMENTS

[0034] The present invention will be described more fully hereinafter with reference to the accompanying drawings, in which preferred embodiments of the invention are shown. This invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art. In the drawings, like numbers refer to like elements.

[0035] FIG. 1 illustrates a system according to an embodiment of the present invention. A remote terminal 10 is communicatively connected to one or more automated vehicles 20 via a communications network 40. As seen in FIG. 2, the remote terminal 10 may comprise a display unit 11 and a control unit 13. On the display unit 11 image data received from an automated vehicle 20 is displayed. The image data can be provided by one or more cameras on the automated vehicle 20. The image data may also comprise other sensory data, or be communicated along with other sensory data, that can be displayed to the user at the remote terminal 10. The other sensory data can be presented on top of the image data on the display unit 11 to provide an augmented reality view for the user. A user using the control unit generate information to be communicated to the automated vehicle 20, such as driving instructions. The driving instructions may include steering instructions, acceleration or braking instructions and similar. When receiving the image data from the automated vehicle 20 using a communication method as in the present invention, low latency is provided such that minimal delay is achieved between the actual event at the location of the automated vehicle 20, represented for the user on the display unit 11 and to which the user may respond using the control unit 13, and when the automated vehicle 20 receives responsive driving instructions from the remote terminal 10.

[0036] As seen in FIG. 1, one remote terminal 10 can be in communication with several automated vehicles 20. The remote terminal 10 may then be used for monitoring the plurality of automated vehicles 20, and if necessary assume control of a specific automated vehicle 20.

[0037] FIGS. 3 and 4 illustrates embodiments of communication from the remote terminal 10 to the automated vehicle 20 (FIG. 3), and from the automated vehicle 20 to the remote terminal 10 (FIG. 4). Information 12 to be communicated is generated or received by the remote terminal 10 and provided to a packaging unit 14. The packaging unit 14 packages the information 12 into a sequence 30 of N data packets P. The sequence 30 of data packets P is then transmitted by a transmission unit 16 to the automated vehicle 20. At the automated vehicle 20, the data packets P are received and assembled by a receiving unit 28. When the automated vehicle 20 is to communicate information 22 to the remote terminal, as illustrated in FIG. 4, a packaging unit 24 receives the information 22 to be communicated. The packaging unit 24 packages the information 22 into a sequence 30 of N data packets P. The sequence 30 of data packets P is then transmitted by a transmission unit 26 to the remote terminal 10. At the remote terminal 10, the data packets P are received and assembled by a receiving unit 18.

[0038] FIG. 5 illustrates the embodiment wherein both the remote terminal 10 and the automated vehicle 20 communicates information 12, 22 to the other entity using the above described method and units.

[0039] The communication of the information 12, 22 is provided over one or more communications network 40, using two communication links A, B. As further illustrated in FIG. 6, the packaging unit 14 provides a sequence 30 of N data packets P to the transmission unit 16. Each data packet P is also provided with data packet number 6 that is unique for each data packet P in the sequence 30. The data packets P in the sequence 30 is thereby provided with a data packet number of 1, 2, 3, . . . N, respectively. The sequence 30 of N data packets thereby comprises data packets P.sub.1, P.sub.2, P.sub.3, . . . P.sub.N. When the transmission unit 16 transmits the sequence 30 of N data packets, it is sent over two communication links A, B. On a first communication link A, the sequence 30 of data packets is sent with the data packets P in an ascending order, i.e. in the order of P.sub.1, P.sub.2, P.sub.3, . . . P.sub.N. On a second communication link B, the sequence 30 of data packets is sent with the data packets P in a descending order, i.e. in the order of P.sub.N, . . . P.sub.3, P.sub.2, P.sub.1.

[0040] In the embodiment illustrated in FIG. 6, the receiving unit 28 comprises one or more receivers 27 that receives the data packets P communicated over the first communication link A and the second communication link B. The receiving unit 28 further comprises an assembling unit 29 that assembles the received data packets P to the complete sequence 30 of data packets. The assembling unit 29 uses the data packets P that are first received on either of the communication links A, B for the assembling of the complete sequence 30. In the illustrated embodiment of FIG. 6, the assembling unit 29 would start assembling a complete sequence 30 of the communicated data packets P using the data packet P.sub.1 and the data packet P.sub.N, since those two are first received on the respective communication link A, B. Next, the data packets P.sub.2 and P.sub.N-1 will be received and used by the assembling unit 29. Consequently, only about half of the sequence 30 of data packets P would need to have been received by the receiving unit 28 before the assembling unit 29 can have assembled the complete sequence 30 of data packets P. The embodiment illustrated in FIG. 6 applies equally in the situation when the automated vehicle 20 is to communicate information 22 to the remote terminal 10. The transmission unit 26 of the automated vehicle 20 will then transmit the sequence 30 of data packets P over two communication links A, B, and the receiving unit 18 of the remote terminal would receive and assemble the received data packets P correspondingly.

[0041] FIG. 7 illustrates a data packet P.sub.1 that comprises a header 4 and a data payload 2. The data payload 2 is received by the packaging unit 14, 24 as part of the information 12, 22 to be communicated. The packaging unit 14, 24 provides the data payload 2 with a header 4, forming the data packet P. As part of the header 4, the data packet P is provided with the data packet number 6. In the sequence 30 of data packets P, each data packet P is given a unique data packet number 6. If a sequence of ten data packets is formed by the packaging unit 14, 24, the data packets forming the sequence are given the data packet numbers 1 to 10 respectively. In some embodiments, the header 4 comprises further fields. For instance, the header 4 may be defined using a protocol, and the header may comprise a protocol identification field.

[0042] FIG. 8 illustrates a method 100 for communicating information between an automated vehicle 20 and a remote terminal 10 according to an embodiment of the present invention. The method 100 may be computer-implemented and comprises a step 102 of providing information to be communicated. The information 12, 22 may be received by the one of the automated vehicle 20 and the remote terminal 10 that is to communicate the information 12, 22, or it can be generated by the same entity. The information 12, 22 to be communicated is packaged 104 by means of the packaging unit 14, 24 to the sequence 30 of N data packets P. In the step of packaging 104, each data packet P is provided with a unique data packet number 6 ranging from 1 to N. The data packet number 6 indicates the respective data packet's position in the sequence 30 of data packets P.

[0043] When the sequence 30 of N data packets P has been formed by the packaging unit 14, 24, the sequence 30 is transmitted 106 via at least two communication links A, B. The transmission 106 is made by means of a transmission unit 16, 26. The transmission unit 16, 26 transmits the sequence 30 of N data packets, each having a unique data packet number 6, over two communication links A, B. Over the first communication link A, the transmission unit 16, 26 transmits the sequence 30 in an order of ascending data packet numbers 6. Over the second communication link B, the transmission unit 16, 26 transmits the sequence 30 in an order of descending data packet numbers 6.

[0044] Finally, the receiving entity out of the automated vehicle 20 and the remote terminal 10 assembles 108 a complete sequence 30 of the unique data packets after each unique data packet P has been successfully communicated via either the first or the second communication link A, B.

[0045] In the drawings and specification, there have been disclosed preferred embodiments and examples of the invention and, although specific terms are employed, they are used in a generic and descriptive sense only and not for the purpose of limitation, the scope of the invention being set forth in the following claims.