Distributing path delay data in a connection-oriented communications network
10075258 ยท 2018-09-11
Assignee
Inventors
Cpc classification
International classification
Abstract
A connection-oriented communications network comprises a plurality of interconnected nodes. A traffic path can be set up across the network. Path delay data is obtained for the traffic path by using control plane signalling messages (e.g. a Resource Reservation Protocol-Traffic Engineering, RSVP-TE signalling message) between nodes of the traffic path. The path delay data can be path delay asymmetry data indicative of an asymmetry in path delay between a forward transmission direction and a reverse transmission direction of the traffic path. Each intermediate node along the traffic path can form a signalling message for forwarding to the downstream node which includes one or more values of path delay incurred by that node, or an accumulated path delay value. The path delay can result from one or more of mapping delay, Forward Error Correction (FEC) coding and propagation delay.
Claims
1. A method of distributing path delay data across a connection-oriented communications network comprising a plurality of interconnected nodes, the method comprising, at an intermediate node of a traffic path across the network: receiving a Resource Reservation Protocol-Traffic Engineering (RSVP-TE) control plane signalling message from an upstream node of the traffic path which comprises path delay data indicative of path delay incurred by at least the upstream node of the traffic path; acquiring path delay data indicative of a path delay for the traffic path incurred by at least one of the intermediate node and a link connecting the intermediate node to another node; forming a RSVP-TE control plane signalling message comprising the path delay data indicative of a path delay incurred by at least one of the intermediate node and a link connecting the intermediate node to another node; sending the RSVP-TE control plane signalling message to a downstream node of the traffic path; receiving a RSVP-TE control plane signalling message which has been returned via at least one downstream node of the traffic path which carries path delay data contributed by the downstream nodes; and forwarding the RSVP-TE control plane signalling message to the upstream node of the traffic path.
2. The method according to claim 1 wherein the path delay data in the received RSVP-TE control plane signalling message is indicative of an asymmetry in path delay between a forward transmission direction and a reverse transmission direction of the traffic path.
3. The method according to claim 1 wherein the path delay data in the received RSVP-TE control plane signalling message is an accumulated path delay for the traffic path and the method further comprises determining a new accumulated path delay based on the accumulated path delay data in the received RSVP-TE control plane signalling message and a path delay incurred by the intermediate node, and wherein the step of forming a RSVP-TE control plane signalling message forms a RSVP-TE control plane signalling message which includes the accumulated path delay.
4. The method according to claim 1 wherein the step of acquiring path delay data comprises at least one of: determining a delay due to mapping data; determining a delay due to performing forward error correction; and determining a delay due to propagation along a network link.
5. The method according to claim 1 wherein the method is performed repeatedly during operation of the traffic path.
6. The method according to claim 5 wherein a source of variable path delay in the network is justification events caused by mapping signals and wherein a period between iterations of the method is less than a period between justification events occurring in the network.
7. The method according to claim 5 wherein a source of variable path delay in the network is justification events caused by mapping signals and the method further comprises determining information about behaviour of the variable path delay during the period between iterations of the method.
8. The method according to claim 1 which is performed for at least one of: establishment of the traffic path; in response to a change occurring in the traffic path; and expiry of a predetermined time interval.
9. A method of distributing path delay data across a connection-oriented communications network comprising a plurality of interconnected nodes, the method comprising, at an ingress node of a traffic path across the network: acquiring path delay data indicative of a path delay for the traffic path incurred by at least one of the ingress node and a link connecting the ingress node to another node; forming a Resource Reservation Protocol-Traffic Engineering (RSVP-TE) control plane signalling message which comprises the path delay data; sending the RSVP-TE control plane signalling message only to a downstream node of the traffic path; and receiving a RSVP-TE control plane signalling message which has been returned via downstream nodes of the traffic path which carries path delay data contributed by the downstream nodes.
10. The method according to claim 9 wherein the path delay data is path delay asymmetry data indicative of an asymmetry in path delay between a forward transmission direction and a reverse transmission direction of the traffic path.
11. A method of distributing path delay data across a connection-oriented communications network comprising a plurality of interconnected nodes, the method comprising, at an egress node of a traffic path across the network: receiving a Resource Reservation Protocol-Traffic Engineering (RSVP-TE) control plane signalling message from an upstream node of the traffic path comprising path delay data indicative of path delay incurred by at least the upstream node; acquiring path delay data indicative of a path delay for the traffic path incurred by at least one of the egress node and a link connecting the egress node to another node; forming a RSVP-TE control plane signalling message comprising the path delay data indicative of a path delay incurred by at least one of the egress node and a link connecting the egress node to another node; and sending the RSVP-TE control plane signalling message to the upstream node of the traffic path.
12. The method according to claim 11 wherein the path delay data in the received RSVP-TE control plane signalling message is indicative of an asymmetry in path delay between a forward transmission direction and a reverse transmission direction of the traffic path.
13. The method according to claim 11 wherein the path delay data in the received RSVP-TE control plane signalling message is an accumulated path delay for the traffic path and the method further comprises determining a new accumulated path delay based on the accumulated path delay data in the received RSVP-TE control plane signalling message and a path delay incurred by the egress node, and wherein the step of forming a RSVP-TE control plane signalling message forms a RSVP-TE control plane signalling message which includes the accumulated path delay.
14. A method of performing time synchronisation between a master clock at a master node and a slave clock at a slave node across a communications network, the method comprising, at the slave node: using a time protocol to synchronise the slave clock with the master clock using forward and reverse communications between the master node and the slave node; and compensating for an asymmetry between the forward and reverse communications using path delay data which is acquired using the method according to claim 1.
15. An apparatus for use at an intermediate node of a traffic path in a connection-oriented communications network comprising a plurality of interconnected nodes for distributing path delay data across the connection-oriented communications network, the apparatus comprising: a control plane interface, wherein the control plane interface is configured to communicate with other nodes of the traffic path; and an operation controller, wherein the operation controller is arranged to: receive a Resource Reservation Protocol-Traffic Engineering (RSVP-TE) control plane signalling message from an upstream node of the traffic path which comprises path delay data indicative of path delay incurred by at least the upstream node of the traffic path; acquire path delay data for the traffic path indicative of a path delay incurred by at least one of the intermediate node and a link connecting the intermediate node to another node; form a RSVP-TE control plane signalling message comprising the path delay data indicative of a path delay incurred by at least one of the intermediate node and a link connecting the intermediate node to another node; send the RSVP-TE control plane signalling message to a downstream node of the traffic path; receive a RSVP-TE control plane signalling message which has been returned via at least one downstream node of the traffic path which carries path delay data contributed by the downstream nodes; and forward the RSVP-TE control plane signalling message to the upstream node of the traffic path.
16. An apparatus for use at an ingress node of a traffic path in a connection-oriented communications network comprising a plurality of interconnected nodes for distributing path delay data across the connection-oriented communications network, the apparatus comprising: a control plane interface, wherein the control plane interface is configured to communicate with other nodes of the traffic path; and an operation controller, wherein the operation controller is arranged to: acquire path delay data for the traffic path indicative of a path delay incurred by at least one of the ingress node and a link connecting the ingress node to another node; form a Resource Reservation Protocol-Traffic Engineering (RSVP-TE) control plane signalling message which comprises the path delay data; send the RSVP-TE control plane signalling message only to a downstream node of the traffic path; and receive a RSVP-TE control plane signalling message which has been returned via downstream nodes of the traffic path which carries path delay data contributed by the downstream nodes.
17. An apparatus for use at an egress node of a traffic path in a connection-oriented communications network comprising a plurality of interconnected nodes for distributing path delay data across the connection-oriented communications network, the apparatus comprising: a control plane interface, wherein the control plane interface is configured to communicate with other nodes of the traffic path; and an operation controller, wherein the operation controller is arranged to: receive a Resource Reservation Protocol-Traffic Engineering (RSVP-TE) control plane signalling message from an upstream node of the traffic path comprising path delay data indicative of path delay incurred by at least the upstream node; acquire path delay data for the traffic path indicative of a path delay incurred by at least one of the egress node and a link connecting the egress node to another node; form a RSVP control plane signalling message comprising the path delay data indicative of a path delay incurred by at least one of the egress node and a link connecting the egress node to another node; and send the RSVP control plane signalling message to the upstream node of the traffic path.
18. A nontransitory machine-readable medium carrying instructions which, when executed by a processor, cause the processor to perform a method of distributing path delay data across a connection-oriented communications network comprising a plurality of interconnected nodes, the method comprising, at an intermediate node of a traffic path across the network: receiving a Resource Reservation Protocol-Traffic Engineering (RSVP-TE) control plane signalling message from an upstream node of the traffic path which comprises path delay data indicative of path delay incurred by at least the upstream node of the traffic path; acquiring path delay data indicative of a path delay for the traffic path incurred by at least one of the intermediate node and a link connecting the intermediate node to another node; forming a RSVP-TE control plane signalling message comprising the path delay data indicative of a path delay incurred by at least one of the intermediate node and a link connecting the intermediate node to another node; sending the RSVP-TE control plane signalling message to a downstream node of the traffic path; receiving a RSVP-TE control plane signalling message which has been returned via at least one downstream node of the traffic path which carries path delay data contributed by the downstream nodes; and forwarding the RSVP-TE control plane signalling message to the upstream node of the traffic path.
Description
BRIEF DESCRIPTION OF THE DRAWINGS
(1) Embodiments of the invention will be described, by way of example only, with reference to the accompanying drawings in which:
(2)
(3)
(4)
(5)
(6)
(7)
(8)
(9)
(10)
(11)
(12)
(13)
(14)
(15)
(16)
(17)
(18)
(19)
(20)
(21)
(22)
(23)
DETAILED DESCRIPTION
(24)
(25)
(26) In use, traffic paths are established in the data plane 5 between nodes 10 of the network 4. A traffic path can be formed between an ingress node and an egress node, via one or more intermediate nodes. Paths are set-up and torn down by control plane signalling, such as Generalised Multi-Protocol Label Switching signalling. The term traffic path can be a Label Switched Path (LSP). In
(27)
(28) Each node N1-N4 collects path delay data which is indicative of path delay incurred at that node and holds the path delay data in a store 34. One form of path delay is mapping delay. This can occur when Ethernet packets/frames are mapped to OTN containers and when Ethernet packets/frames are de-mapped from OTN containers. This delay can be related to the depth of FIFOs where the Ethernet client is mapped. Mapping delay in the forward direction will be called d.sub.mf and mapping delay in the reverse direction will be called d.sub.mr. In this specification the term mapping also includes multiplexing/de-multiplexing OTN containers between different OTN levels.
(29) Another form of path delay is processing delay which results from Forward Error Correction (FEC) or Adaptive Forward Error Correction (AFEC) coding. This can be related to the depth of the FEC/AFEC coding buffer which can be used to calculate the additional delay related to this second process (when applicable). Coding delay in the forward direction will be called d.sub.fecf and coding delay in the reverse direction will be called d.sub.fecr.
(30) Propagation delay resulting from propagation across an optical fibre between a first node and a second node can be known by a node. (Fibre) propagation delay in the forward direction will be called d.sub.ff and propagation delay in the reverse direction will be called d.sub.fr. An asymmetry in propagation delay can arise where traffic in a forward direction and traffic flowing in a reverse direction use different fibres with different transmission characteristics (e.g. fibre length, wavelength). An asymmetry in propagation delay can arise where traffic in a forward direction and traffic flowing in a reverse direction use the same fibre but different wavelengths, with forward traffic using a first wavelength and reverse traffic using a second wavelength. Propagation delay between a pair of nodes can be calculated in various ways known in the art. One exemplary method is described in ITU-T G.8271 in Appendix I.6.
(31) Other types of delay can be measured and/or stored by a node. Some of the types of delay may only occur at particular nodes. For example, mapping delay may only occur at an ingress node where traffic is mapped into OTN containers and at an egress node where traffic is removed from OTN containers. However, if intermediate nodes perform multiplexing/demultiplexing for OTN traffic consolidation (e.g. mapping lower order data units into higher order data units) then further mapping delays may occur at intermediate nodes. FEC delay may occur at ingress nodes and egress nodes. FEC delay may also occur at an intermediate node where regeneration of an optical signal is performed and there is opto-electro-opto conversion.
(32) For an application such as time synchronisation, the asymmetry in path delay between the forward path and reverse path is required by a node which performs time synchronisation. The asymmetry at each node (plus forward and reverse fibres connected to that node) can be calculated from the component delays described above, as:
A=(d.sub.mf+d.sub.fecf+d.sub.ff)(d.sub.mr+d.sub.fecr+d.sub.fr)
For the full traffic path between node N1 and N4, the path delay (or asymmetry in path delay) of each node N1-N4 and links between nodes N1-N4 are required. In accordance with embodiments of the invention, path delay data is collected from the nodes N1-N4 forming a traffic path across network 4. The collected data can then be used by a node which requires the path delay data or path delay asymmetry data.
(33) Several possible ways in which path delay can be collected are now described.
(34) Collecting an Accumulated Path Delay (Path Delay Asymmetry)
(35) A control plane signalling message (e.g. an RSVP-TE Path message) is forwarded, via the control plane 6, from the ingress node N1, via intermediate nodes N2, N3, to the egress node N4 of the traffic path. At each node, the node calculates a new accumulated value of path delay (path delay asymmetry) based on the value of path delay received in the message from the upstream node and the value of the path delay contributed by that node. The node then forwards a signalling message to the next downstream node with the new accumulated value. The egress node N4 receives a message with an accumulated value representing the path delay (path delay asymmetry) contributed by all of nodes N1-N3. Node N4 can then add the path delay (path delay asymmetry) contribution of node N4 to provide a final accumulated path delay (path delay asymmetry) value. Egress node N4 then returns a signalling message (e.g. an RSVP-TE Resv message) with the total accumulated path delay (path delay asymmetry) value along the sequence of nodes N4-N3-N2-N1 of the traffic path. Egress node N4 can signal the accumulated path delay value to another network or network entity, or ingress node N1 can signal the accumulated path delay value to another network or network entity.
(36)
(37) Collecting Component Path Delays (Path Delay Asymmetries)
(38) A control plane signalling message (e.g. an RSVP-TE Path message) is forwarded, via the control plane, from the ingress node N1, via intermediate nodes N2, N3, to the egress node N4 of the traffic path. At each node, the node adds a path delay (path delay asymmetry) contributed by that node and forwards a message to the next node. The egress node N4 receives a signalling message with a list of component path delays (path delay asymmetries) contributed by each of the nodes N1-N3 of the traffic path. Node N4 can then add the path delay (path delay asymmetry) contribution of node N4 to the list of values. Egress node N4 then returns a signalling message (e.g. an RSVP-TE Resv message) along the sequence of nodes N4-N3-N2-N1 of the traffic path. Egress node N4 can signal the accumulated path delay value to another network, or ingress node N1 can signal the accumulated path delay value to another network. Each node N1-N4 of the traffic path can contribute a single value, representing a sum of all of the sources of path delay at the node (or an overall path delay asymmetry), or it can forward a set of values, representing each source of path delay (path delay asymmetry), such as separate values for each of mapping delay, FEC delay, propagation delay.
(39) Collecting Path Delay Data Over Forward and Reverse Paths
(40) In the options described above, a control plane signalling message (e.g. an RSVP-TE Path message) is forwarded, via the control plane, from the ingress node N1, via intermediate nodes N2, N3, to the egress node N4 of the traffic path. During the forward passage of the signalling message, each node of the traffic path contributes one or more path delay values indicative of the forward and reverse path delay at that node. By the time the signalling message reaches the egress node N4, the signalling message contains all of the path delay data for forward and reverse paths (or path delay asymmetry between forward and reverse paths) for the entire traffic path N1-N4. The signalling message received at egress node N4 will either comprise a single accumulated value of path delays (path delay asymmetries) contributed by nodes, or a list of component path delays (path delay asymmetries). In an alternative method, each node only contributes a forward path delay as the signalling message is sent in the forward direction between node N1 and node N4, and contributes a reverse path delay as the signalling message is sent in the reverse direction between node N4 and node N1. For example, node N2 could contribute a value of +5 units, representing the forward path delay at node N2, as a signalling message is received from N1 (travelling in the forward direction towards node N4), and could contribute a value of +2 units, representing the reverse path delay at node N2, as a signalling message is received from node N3 (travelling in the reverse direction towards node N1).
(41) In each of the alternatives described above a node N1-N4 can have many different traffic paths passing via the node and the path delay (asymmetry) can be different for each traffic path. For example, the delay may differ due to different mapping techniques or traffic loads, different FEC types, or links which differ in length and/or wavelength. The signalling message (e.g. RSVP-TE message) contains data which identifies the traffic path (Label Switched Path, LSP). During a setup phase of a traffic path each node relates an LSP identifier to physical resources used by that traffic path and the related processing. This is implementation dependent but, for example, each LSP can be related to one upstream and one downstream port (with, for example, relevant delays associated to the fibre length) and the data that is associated to the LSP is processed in some LSP-specific way (for example with an appropriate multiplexing/demultiplexing). The method performed at a node N1-N4 can comprise: the node receiving the signalling message; the node identifying the traffic path (LSP) that the message relates to; the node recovers the list of resources the LSP is related to; and the node checks the path delay data (path delay asymmetry data) related to the use of the resources that have been identified.
(42) In each of the alternatives described above, one of the possible sources of path delay is propagation delay due to passage over an optical fibre link, or an asymmetry in propagation delay over forward and reverse paths over a bi-directional link, or a pair of forward and reverse links The propagation delay can either be contributed by the node at the start of the link, or by the node at the end of the link (when viewed in the direction from ingress node to egress node). For example, in
(43) Advantageously, a node has the capability to compute a path delay based on measurements made by the node. If a node does not have this capability, then it is possible that the node can send measurements, or the results of intermediate calculations, to another node, and for another node to perform the calculation. The term path delay data can include data acquired by a node which will allow another node to calculate a path delay, or path delay asymmetry. The data can be carried in a field of the signalling message which is forwarded between nodes of the traffic path.
(44)
(45) Step 105 of the method forms a signalling message which comprises the path delay data. Step 106 of the method sends the signalling message to a downstream node of the traffic path. This is the next node (N2) along the traffic path.
(46) The method can comprise a step 107 of receiving a signalling message which has been returned via downstream nodes of the traffic path which carries path delay data contributed by the downstream nodes. This corresponds to
(47)
(48) Step 115 forms a signalling message which comprises the path delay data. Step 115 can comprise a step 116 of determining a new accumulated path delay based on the path delay data received at step 110 and the path delay acquired at step 111. Consider that the intermediate node N computes path delay asymmetry. A signalling message received from an upstream node (N1) carries a path delay asymmetry value=A(N1). Node N calculates a new accumulated path delay asymmetry value:
A(N)=A(N1)+(d.sub.mf+d.sub.fecf+d.sub.ff)(d.sub.mr+d.sub.fecr+d.sub.fr).
The value A(N) is inserted in the path message going to the downstream node (N+1).
(49) Step 117 sends the signalling message to a downstream node of the traffic path. This is the next node (N3 or N4) along the traffic path. Advantageously, the message is only sent to the next downstream node of the traffic path, and is not sent to any other nodes.
(50) The method can comprise a step 118 of receiving a signalling message which has been returned via downstream nodes of the traffic path which carries path delay data contributed by the downstream nodes. At step 119 the ingress node forwards the signalling message to the upstream node of the traffic path.
(51)
(52) Step 125 forms a signalling message which comprises the path delay data. Step 115 can comprise a step 116 of determining a new accumulated path delay based on the path delay data received at step 110 and the path delay acquired at step 111.
(53) Optionally, step 128 can send a signalling message to notify another node of the path delay, such as anode of a client network connected to network 4.
(54) Frequency of the RSVP Refresh Mechanism
(55) The calculation and distribution of path delay data (path delay asymmetry data) can be performed when a traffic path (LSP) is set up and can be performed in response to major changes in the network such as Link Protection, fibre maintenance changing the length of a fibre. Such events may occur as infrequently as once per month or a few times per year. During these events, an alarm may be sent to the client node to indicate that path delay data (path delay asymmetry data) is being updated and the client is recommended to enter a holdover state while updates path delay data is collected for the traffic path.
(56) It is possible to collect updated path delay data using an RSVP-TE refresh mechanism. Periodically, new RSVP-TE Path and Resv messages can be exchanged between the nodes and if any asymmetry contribution changes it is possible to compute again the total value (that can be sent to NMS with a new notification). Further signalling messages are sent as described above.
(57) The GMPLS network architecture comprises a network of Network Elements (NE) running a GMPLS protocol stack, which forms the control plane (6,
(58) Length=8(4 header bytes and 4 bytes for the object content);
(59) Class-Num=188 (or any other value reserved for private use, as described in http://www.iana.org/assignments/rsvp-parameters/rsvp-parameters.xml);
(60) C-type=1 (any value. For example, 1 may be defined as Circuit Asymmetry expressed in picoseconds);
(61) Object content=a 32 bit integer (meaning from 2,147,483,648 psec to 2,147,483,647 psec in case of C-Type=1).
(62)
(63)
(64) In
(65) The time protocol (e.g. PTP) assumes that path delays in the forward and reverse directions are equal but the optical communications network 4 may cause different path delays in the forward and reverse directions, which can affect time synchronisation. One cause of asymmetry is propagation delay asymmetry. In
(66)
(67)
(68)
(69)
(70)
(71) If the path delay data is in the form of a list of component path delay values, then an entity in the server network 4 (e.g. parameter calculation module 74 at the NMS 70) or an entity in the client network (e.g. parameter calculation module 84 at node 2) can calculate a path delay asymmetry based on the list of component path delay values.
(72) As described above, asymmetry at each node (plus forward and reverse fibres connected to that node) can be calculated from the component delays described above, as:
A=(d.sub.mf+d.sub.fecf+d.sub.ff)(d.sub.mr+d.sub.fecr+d.sub.fr)
For the full traffic path, path delay asymmetries at every node and link are summed. This summation may occur as part of the collection (
(73) delayAsymmetry=A/2
(74) Note: there can be other deterministic sources of asymmetries (e.g. different rates on the egress and ingress lines) that may need to be taken into account in the delayAsymmetry calculation performed by the PTP client node. Once the delayAsymmetry is calculated, this can be made available to the function that processes the PTP packets as to properly update the correction fields as specified in IEEE 1588.
Handling of Asynchronous Clocks
(75) A variable mapping delay can occur due to the fact that clocks in an OTN network are asynchronous and the data can slowly change position in the mapping buffers of the OTN network, thus resulting in periodic justifications. If the frequency of the justifications is lower than the filtering capability of the desynchroniser, there could be significant impacts on the phase noise and therefore delays and resulting asymmetries on the client signals. For example, 1 Gbit/s rate in case of 1 ppb clock difference, would result in a justification with a periodicity in the order of 10 seconds, which is significantly lower frequency then the desynchroniser bandwidth (typically in the order of 100 Hz). This would result in additional tens of ns variable asymmetry produced by the OTN network that might be desirable to control.
(76) Asynchronous clocks used at network nodes 11, 12, 13 can cause mapping delay to vary over time and therefore path delay asymmetry to vary over time. Mapping of client signals to/from OTN data units occurs at ingress nodes and egress nodes. Mapping due to ODU multiplexing can occur in any of nodes 11-13, that is anywhere a Lower Order Protocol Data Unit (LO PDUk) is mapped to/from a Higher Order Optical Channel Data Unit (HO ODUk).
(77) Monitoring of justification occasions in the mapping/multiplexing can be used to control the impact of variable delays and asymmetries due to justification. Advantageously, a period between justifications introduced by the mapper or multiplexing stage should occur be less than the period between two RSVP-TE signalling exchanges to update path delay data.
(78) Advantageously, additional information can be used to predict the behaviour of the path delay over time, between the occasions when signalling determines the actual path delay values. This is particularly useful in situations where justifications occur more frequently than the signalling exchanges.
(79) If an asynchronous clock generates frequent justification opportunities, a mapper can record in a table the number of justifications and the time when they are required. When a signalling message (e.g. RSVP-TE message described above) is sent from a node, it is possible to send, together with the current value of path delay, some additional information that can be used to predict the variation of the delay over time (e.g. number of justifications over time, their variation over time, which corresponds to the absolute frequency offset and to the linear drift of the frequency deviation respectively.) This additional information can be used to predict the behaviour of the delay over time, between the occasions when signalling determines the actual path delay values.
(80) There are various cases depending on the signal that is mapped and the mapping procedure (AMP or GMP). Two examples are described. In the first example, four ODU1 signals are multiplexed into an OPU2 signal via an ODTUG2. In the second example a Gigabit Ethernet (GbE, 1000BaseX) signal is mapped into ODU0 and the ODU0 is multiplexed to a HO ODUk container (one or more orders of multiplexing is considered).
EXAMPLE 1
(81) Four ODU1 signals are multiplexed into an OPU2 signal via the ODTUG2. An ODU1 signal is extended with frame alignment overhead and asynchronously mapped into the Optical channel Data Tributary Unit 1 into 2 (ODTU12) using the AMP justification overhead (JOH). The four ODTU12 signals are time-division multiplexed into the Optical channel Data Tributary Unit Group 2 (ODTUG2) with payload type 20, after which this signal is mapped into the OPU2. A byte of the ODU1 signal is mapped into an information byte of the ODTU12. Twice per 8 OPU2 frames, it is possible to perform either a positive or a negative justification action. This means that, in this example, phase steps of about 7 ns would be implied by the justification. If these are slower than the time constant of the desynchroniser (i.e. period higher than about 2 ms, that would mean about 4 ppm frequency difference) which would impact the phase noise on the output of the network.
EXAMPLE 2
(82) GbE Mapping into ODU0 is performed according to G.709 clause 17.7.1. At first the GbE rate (1.250 Gb/s100 ppm or 4.6 ppm for SyncE) is reduced via TTT (=Timing Transparent Transcoding) down to 1.171875 Gb/s, then this is managed as a Continuous Bit Rate (CBR) and mapped into the OPU0 via GMP, allocating all the needed stuffing bytes according to the GMP algorithm. The number of available 8-bit (byte) locations in the OPU0 is 15232. The number of necessary locations can change frame per frame according to the actual misalignment between the client and the server frequencies which are varying in real time. In fact the GMP accommodation process decides the number of needed locations (C.sub.n) in frame #i, insert this information in the OPU OH frame #i and then put the relevant C.sub.n client data in the frame #i+1. The number C.sub.n of needed locations depends on the relation between f.sub.server and f.sub.client and it can vary as follows:
(83) C.sub.n=1440514410 (with f.sub.client at 100 ppm and f.sub.server at 20 ppm)
(84) C.sub.n=1440614408 (with f.sub.client at 4.6 ppm and f.sub.server at 20 ppm)
(85) This means that the number of bytes which is needed to store is at maximum 5 in the first case and 2 in the second case. At the demapper no delay has to be accounted because the extraction information is provided in the frame #i for the next frame #i+1. Therefore, in summary, we have: GMP Mapping delay (+/100 ppm): 5 bytes (32 ns at 1 GbE rate) GMP Mapping delay (+/4.6 ppm): 2 bytes (13 ns at 1 GbE rate) GMP Demapping delay: 0 byte no delay
This delay is therefore due to the variation of the needed justification opportunities foreseen by the GMP process when a GbE is mapped, according to the standard, into and OPU0/ODU0 container. Necessarily after this, the ODU0 has to be multiplexed together with other LO containers into an HO ODUk (one or more level of multiplexing are theoretically possible). In any case, not depending on the type of multiplexing (ODU0 into ODTU01 or ODU0 into ODTUk.ts or, in general, ODUj into ODTUjk or ODUj into ODTUk.ts), this operation implies at maximum two additional justification opportunities which are approximately 13 ns at 1 GbE rate (please note that an exception is only the mapping of an ODU2e into an HO ODUk which potentially requires more justification opportunities (4/5 bytes), but this is not applicable to the case of GbE which is never mapped via ODU2e.
(86) Information related to the justification opportunities (both via AMP or GMP) is calculated by the hardware and stored in the OPU OH in each node where a signal mapping or multiplexing is performed. By monitoring and recording the number of justifications over certain time windows, it is possible to: estimate in real time the frequency offset between the clocks; estimate how fast the frequency offset varies in the time (to evaluate if the variation can be managed); request updates of asymmetry information under certain conditions, e.g. if the frequency of the justifications is 5 minutes, it could be requested to refresh RSVP-TE exchange every minute. signal the precision of such estimate so that the end application is aware of the potential error in the time distribution chain. This information is used by the PTP clients (PTP slave).
(87) The frequency of updates, and therefore the interval between performing iterations of the method of obtaining path delay data, can be a parameter to be configured by the network operator or it can be related to monitoring the frequency of the justifications. As the estimation of the frequency offset between clocks may present some errors it is always recommended to have an exchange of RSVP-TE more often than the rate of the justification. For example, ten times more frequent. Typically there is an upper limit on frequency of sending messages (e.g. not more often than one packet per minute). The method of obtaining path delay data is performed repeatedly during operation of a traffic path and a period between iterations of the method is less than a period between justification events in the network.
(88) In general, assuming that the refresh of the RSVP-TE method is done at most every 1 min and assuming that the output clock signal is automatically filtered for variation faster than 2 ms, all the phase noise due to mapping justifications variation would be present on the outgoing signal only if the frequency of the justifications is below a few minutes min and above 2 ms.
(89) The above method also allows estimating the overall frequency variation of the justification occasions in each node where a mapping or multiplexing is required. It is therefore possible to communicate via RSVP-TE not only the delay variation due to justification, but also the estimated derivative of the frequency variation in order to predict how the delay will vary in the time between two consecutive RSVP-TE updates.
(90) Alternative Methods for Collecting/Distributing Path Delay Data
(91) In the methods described above a signalling message is forwarded between nodes of a traffic path and path delay data is collected as the message is forwarded. Some alternative ways of collecting path delay data will now be described.
(92) Another method of obtaining path delay data from nodes of the communications network 4 is shown in
(93) Another method of obtaining path delay data from nodes of the communications network 4 is shown in
(94) The methods described above can be combined with any of the features of the earlier described methods.
(95)
(96) The master sends a Sync message to the slave and notes the time, t1, at which it was sent.
(97) The slave receives the Sync message and notes the time of reception, t2.
(98) The master conveys to the slave the timestamp t1 by embedding the timestamp t1 in the Sync message. This requires some sort of hardware processing for highest accuracy and precision. Alternatively, the master can embed the timestamp t1 in a Follow_Up message.
(99) The slave sends a Delay_Req message to the master and notes the time, t3, at which it was sent.
(100) The master receives the Delay_Req message and notes the time of reception, t4.
(101) The master conveys to the slave the timestamp t4 by embedding it in a Delay_Resp message.
(102) At the conclusion of this exchange of messages, the slave possesses all four timestamps: t1, t2, t3, t4. These timestamps may be used to compute the offset of the slave's clock with respect to the master and the mean propagation time of messages between the two clocks, which in
(103) The time error between a slave and master ordinary or boundary clock (<offsetFromMaster>) is defined as:
<offsetFromMaster>=<Time on the slave clock><Time on the master clock>
where all times are measured at the same instant. In particular, the <offsetFromMaster> value shall be computed by the slave as follows:
(104) If a Follow_Up message will not be received, then
<offsetFromMaster>=(t2t1)<meanPathDelay>correctionField of Sync message.
(105) If a Follow_Up message will be received, then
<offsetFromMaster>=(t2t1)<meanPathDelay>correctionField of Sync messagecorrectionField of Follow_Up message
where correction field of Sync message relates to the support in the transport network (i.e. Transparent Clocks adding information on the latency for the packet crossing the transport network element).
The nominal value of the <meanPathDelay> is computed as
<meanPathDelay>=[(t.sub.2t.sub.1)+(t.sub.4t.sub.3)]/2=[(t.sub.2t.sub.3)+(t.sub.4t.sub.1)]/2
The scheme is slightly different in case of Peer-to-Peer Transparent clocks where the Path delay is calculated at each hop and included in the correction field of the sync message (or Follow-up message in case of 2-steps clock) in addition to the latency.
(106) From the above description it is clear that the computation of offset and propagation time assumes that the master-to-slave and slave-to-master propagation times are equal. Any asymmetry in propagation time introduces an error in the computed value of the clock offset. The computed mean propagation time differs from the actual propagation times due to the asymmetry.
(107) If the delay Asymmetry of the path connected to the ingress port is known, the corrections can be made as specified by the PTP protocol (see section 11.6 of IEEE 1588-2008, IEEE Standard for a Precision Clock Synchronization Protocol for Network Measurement and Control System). In particular, IEEE 1588 defines the attribute delayAsymmetry as follows (see 7.4 in IEEE 1588); for t-ms and t-sm definitions:
t-ms=<meanPathDelay>+delayAsymmetry
t-sm=<meanPathDelay>delayAsymmetry
In other words, delayAsymmetry is defined to be positive when the master-to-slave or responder-to requestor propagation time is longer than the slave-to-master or requestor-to-responder propagation time. The methods and apparatus described above allow the asymmetry to be calculated and therefore the term delayAsymmetry can include the asymmetry calculated between forward and reverse paths of the optical communications network.
(108)
(109) Other Applications
(110) One upcoming architectural change in mobile access network is the possibility to split conventional Radio Base Stations (RBS) in two parts: a Processing Main Unit (MU) and a set of antennas with dedicated RF equipment able to cover multiple radio cells (RRUs). A single MU is shared among multiple RRUs. This new architectural approach in the RBS implementation require high capacity, cost effective and low latency transport systems between MU (processing) and RRUs (antennas). Nowadays they are realized through the standard protocol CPRI, transmitted over P2P dedicated optical links. CPRI has pressing constraints in terms of latency and in particular in terms of uplink/downlink differential delay. Using WDM technologies as a transmission layer for CPRI could provide great benefits, in terms of efficient use of fibre and MU consolidation. As a drawback, compared with dedicated P2P fibre, accommodating uplink and downlink streams on different fibres and/or wavelengths can have a detrimental effect on the CPRI synchronisation. That effect increases with the length of the link(s), with the difference between the lengths of the two fibres (in case of two fibre systems) and with the wavelength spacing between uplink and downlink wavelengths. The knowledge of uplink and downlink propagation delay differences can be used to apply the proper compensation on the two CPRI streams so that the differential delay is reduced to less than an acceptable threshold value.
(111) Modifications and other embodiments of the disclosed invention will come to mind to one skilled in the art having the benefit of the teachings presented in the foregoing descriptions and the associated drawings. Therefore, it is to be understood that the invention is not to be limited to the specific embodiments disclosed and that modifications and other embodiments are intended to be included within the scope of this disclosure. Although specific terms may be employed herein, they are used in a generic and descriptive sense only and not for purposes of limitation.