Internet DRAFT - draft-ietf-pce-stateful-sync-optimizations
draft-ietf-pce-stateful-sync-optimizations
PCE Working Group E. Crabbe
Internet-Draft Oracle
Intended status: Standards Track I. Minei
Expires: September 28, 2017 Google, Inc.
J. Medved
Cisco Systems, Inc.
R. Varga
Pantheon Technologies SRO
X. Zhang
D. Dhody
Huawei Technologies
March 27, 2017
Optimizations of Label Switched Path State Synchronization Procedures
for a Stateful PCE
draft-ietf-pce-stateful-sync-optimizations-10
Abstract
A stateful Path Computation Element (PCE) has access to not only the
information disseminated by the network's Interior Gateway Protocol
(IGP), but also the set of active paths and their reserved resources
for its computation. The additional Label Switched Path (LSP) state
information allows the PCE to compute constrained paths while
considering individual LSPs and their interactions. This requires a
state synchronization mechanism between the PCE and the network, PCE
and path computation clients (PCCs), and between cooperating PCEs.
The basic mechanism for state synchronization is part of the stateful
PCE specification. This document presents motivations for
optimizations to the base state synchronization procedure and
specifies the required Path Computation Element Communication
Protocol (PCEP) extensions.
Requirements Language
The key words "MUST", "MUST NOT", "REQUIRED", "SHALL", "SHALL NOT",
"SHOULD", "SHOULD NOT", "RECOMMENDED", "MAY", and "OPTIONAL" in this
document are to be interpreted as described in [RFC2119].
Status of This Memo
This Internet-Draft is submitted in full conformance with the
provisions of BCP 78 and BCP 79.
Internet-Drafts are working documents of the Internet Engineering
Task Force (IETF). Note that other groups may also distribute
Crabbe, et al. Expires September 28, 2017 [Page 1]
Internet-Draft Optimizations of state synchronization March 2017
working documents as Internet-Drafts. The list of current Internet-
Drafts is at http://datatracker.ietf.org/drafts/current/.
Internet-Drafts are draft documents valid for a maximum of six months
and may be updated, replaced, or obsoleted by other documents at any
time. It is inappropriate to use Internet-Drafts as reference
material or to cite them other than as "work in progress."
This Internet-Draft will expire on September 28, 2017.
Copyright Notice
Copyright (c) 2017 IETF Trust and the persons identified as the
document authors. All rights reserved.
This document is subject to BCP 78 and the IETF Trust's Legal
Provisions Relating to IETF Documents
(http://trustee.ietf.org/license-info) in effect on the date of
publication of this document. Please review these documents
carefully, as they describe your rights and restrictions with respect
to this document. Code Components extracted from this document must
include Simplified BSD License text as described in Section 4.e of
the Trust Legal Provisions and are provided without warranty as
described in the Simplified BSD License.
Table of Contents
1. Introduction . . . . . . . . . . . . . . . . . . . . . . . . 3
2. Terminology . . . . . . . . . . . . . . . . . . . . . . . . . 4
3. State Synchronization Avoidance . . . . . . . . . . . . . . . 4
3.1. Motivation . . . . . . . . . . . . . . . . . . . . . . . 4
3.2. State Synchronization Avoidance Procedure . . . . . . . . 4
3.2.1. IP Address change during session re-establishment . . 9
3.3. PCEP Extensions . . . . . . . . . . . . . . . . . . . . . 10
3.3.1. LSP State Database Version Number TLV . . . . . . . . 10
3.3.2. Speaker Entity Identifier TLV . . . . . . . . . . . . 11
4. Incremental State Synchronization . . . . . . . . . . . . . . 12
4.1. Motivation . . . . . . . . . . . . . . . . . . . . . . . 12
4.2. Incremental Synchronization Procedure . . . . . . . . . . 13
5. PCE-triggered Initial Synchronization . . . . . . . . . . . . 16
5.1. Motivation . . . . . . . . . . . . . . . . . . . . . . . 16
5.2. PCE-triggered Initial State Synchronization Procedure . . 17
6. PCE-triggered Re-synchronization . . . . . . . . . . . . . . 18
6.1. Motivation . . . . . . . . . . . . . . . . . . . . . . . 18
6.2. PCE-triggered State Re-synchronization Procedure . . . . 18
7. Advertising Support of Synchronization Optimizations . . . . 19
8. IANA Considerations . . . . . . . . . . . . . . . . . . . . . 20
8.1. PCEP-Error Object . . . . . . . . . . . . . . . . . . . . 20
Crabbe, et al. Expires September 28, 2017 [Page 2]
Internet-Draft Optimizations of state synchronization March 2017
8.2. PCEP TLV Type Indicators . . . . . . . . . . . . . . . . 21
8.3. STATEFUL-PCE-CAPABILITY TLV . . . . . . . . . . . . . . . 21
9. Manageability Considerations . . . . . . . . . . . . . . . . 21
9.1. Control of Function and Policy . . . . . . . . . . . . . 21
9.2. Information and Data Models . . . . . . . . . . . . . . . 21
9.3. Liveness Detection and Monitoring . . . . . . . . . . . . 22
9.4. Verify Correct Operations . . . . . . . . . . . . . . . . 22
9.5. Requirements On Other Protocols . . . . . . . . . . . . . 22
9.6. Impact On Network Operations . . . . . . . . . . . . . . 22
10. Security Considerations . . . . . . . . . . . . . . . . . . . 22
11. Acknowledgments . . . . . . . . . . . . . . . . . . . . . . . 23
12. Contributors . . . . . . . . . . . . . . . . . . . . . . . . 23
13. References . . . . . . . . . . . . . . . . . . . . . . . . . 23
13.1. Normative References . . . . . . . . . . . . . . . . . . 23
13.2. Informative References . . . . . . . . . . . . . . . . . 24
Authors' Addresses . . . . . . . . . . . . . . . . . . . . . . . 24
1. Introduction
The Path Computation Element Communication Protocol (PCEP) provides
mechanisms for Path Computation Elements (PCEs) to perform path
computations in response to Path Computation Clients (PCCs) requests.
[I-D.ietf-pce-stateful-pce] describes a set of extensions to PCEP to
provide stateful control. A stateful PCE has access to not only the
information carried by the network's Interior Gateway Protocol (IGP),
but also the set of active paths and their reserved resources for its
computations. The additional state allows the PCE to compute
constrained paths while considering individual LSPs and their
interactions. This requires a state synchronization mechanism
between the PCE and the network, PCE and PCC, and between cooperating
PCEs. [I-D.ietf-pce-stateful-pce] describes the basic mechanism for
state synchronization. This document specifies following
optimizations for state synchronization and the corresponding PCEP
procedures and extensions:
o State Synchronization Avoidance: To skip state synchronization if
the state has survived and not changed during session restart.
(See Section 3.)
o Incremental State Synchronization: To do incremental (delta) state
synchronization when possible. (See Section 4.)
o PCE-triggered Initial Synchronization: To let PCE control the
timing of the initial state synchronization. (See Section 5.)
o PCE-triggered Re-synchronization: To let PCE re-synchronize the
state for sanity check. (See Section 6.)
Crabbe, et al. Expires September 28, 2017 [Page 3]
Internet-Draft Optimizations of state synchronization March 2017
Support for each of the synchronization optimization capabilities is
advertised during the PCEP initialization phase. See Section 7 for
the new flags defined in this document. The handling of each flag is
described in the relevant section.
2. Terminology
This document uses the following terms defined in [RFC5440]: PCC,
PCE, PCEP Peer.
This document uses the following terms defined in [RFC8051]: Stateful
PCE, Delegation, LSP State Database.
This document uses the following terms defined in
[I-D.ietf-pce-stateful-pce]: Redelegation Timeout Interval, LSP State
Report, LSP Update Request.
Within this document, when describing PCE-PCE communications, one of
the PCEs fills the role of a PCC. This provides a saving in
documentation without loss of function.
3. State Synchronization Avoidance
3.1. Motivation
The purpose of state synchronization is to provide a checkpoint-in-
time state replica of a PCC's LSP state in a stateful PCE. State
synchronization is performed immediately after the initialization
phase ([RFC5440]). [I-D.ietf-pce-stateful-pce] describes the basic
mechanism for state synchronization.
State synchronization is not always necessary following a PCEP
session restart. If the state of both PCEP peers did not change, the
synchronization phase may be skipped. This can result in significant
savings in both control-plane data exchanges and the time it takes
for the stateful PCE to become fully operational.
3.2. State Synchronization Avoidance Procedure
State synchronization MAY be skipped following a PCEP session restart
if the state of both PCEP peers did not change during the period
prior to session re-initialization. To be able to make this
determination, state must be exchanged and maintained by both PCE and
PCC during normal operation. This is accomplished by keeping track
of the changes to the LSP state database, using a version tracking
field called the LSP State Database Version Number.
Crabbe, et al. Expires September 28, 2017 [Page 4]
Internet-Draft Optimizations of state synchronization March 2017
The INCLUDE-DB-VERSION (S) bit in the stateful PCE capability TLV
(Section 7) is advertised on a PCEP session during session startup to
indicate that the LSP State Database Version Number is to be included
when the LSPs are reported to the PCE. The LSP State Database
Version Number, carried in LSP-DB-VERSION TLV (see Section 3.3.1), is
owned by a PCC and it MUST be incremented by 1 for each successive
change in the PCC's LSP state database. The LSP State Database
Version Number MUST start at 1 and may wrap around. Values 0 and
0xFFFFFFFFFFFFFFFF are reserved. If either of the two values are
used during LSP state (re)-synchronization, the PCE speaker receiving
this value MUST send back a PCErr with Error-type 20 Error-value TBD6
(suggested value - 6) 'Received an invalid LSP DB Version Number',
and close the PCEP session. Operations that trigger a change to the
local LSP state database include a change in the LSP operational
state, delegation of an LSP, removal or setup of an LSP or change in
any of the LSP attributes that would trigger a report to the PCE.
If the include LSP DB version capability is enabled, a PCC MUST
increment its LSP State Database Version Number when the
'Redelegation Timeout Interval' timer expires (see
[I-D.ietf-pce-stateful-pce] for the use of the Redelegation Timeout
Interval).
If both PCEP speakers set the S flag in the OPEN object's STATEFUL-
PCE-CAPABILITY TLV to 1, the PCC MUST include the LSP-DB-VERSION TLV
in each LSP object of the PCRpt message. If the LSP-DB-VERSION TLV
is missing in a PCRpt message, the PCE will generate an error with
Error-Type 6 (mandatory object missing) and Error-Value TBD1
(suggested value - 12) 'LSP-DB-VERSION TLV missing' and close the
session. If the include LSP DB version capability has not been
enabled on a PCEP session, the PCC SHOULD NOT include the LSP-DB-
VERSION TLV in the LSP Object and the PCE MUST ignore it were it to
receive one.
If a PCE's LSP state database survived the restart of a PCEP session,
the PCE will include the LSP-DB-VERSION TLV in its OPEN object, and
the TLV will contain the last LSP State Database Version Number
received on an LSP State Report from the PCC in the previous PCEP
session. If a PCC's LSP State Database survived the restart of a
PCEP session, the PCC will include the LSP-DB-VERSION TLV in its OPEN
object and the TLV will contain the latest LSP State Database Version
Number. If a PCEP speaker's LSP state database did not survive the
restart of a PCEP session or at startup when the database is empty,
the PCEP speaker MUST NOT include the LSP-DB-VERSION TLV in the OPEN
object.
If both PCEP speakers include the LSP-DB-VERSION TLV in the OPEN
Object and the TLV values match, the PCC MAY skip state
Crabbe, et al. Expires September 28, 2017 [Page 5]
Internet-Draft Optimizations of state synchronization March 2017
synchronization and the PCE does not wait for the end of
synchronization marker [I-D.ietf-pce-stateful-pce]. Otherwise, the
PCC MUST perform full state synchronization (see
[I-D.ietf-pce-stateful-pce]) or incremental state synchronization
(see Section 4 if this capability is advertised) to the stateful PCE.
In other words, if the incremental state synchronization capability
is not advertised by the peers, based on the LSP database version
number match either the state synchronization is skipped or a full
state synchronization is performed. If the PCC attempts to skip
state synchronization, by setting the SYNC Flag to 0 and PLSP-ID to a
non-zero value on the first LSP State Report from the PCC as per
[I-D.ietf-pce-stateful-pce], the PCE MUST send back a PCErr with
Error-Type 20 Error-Value TBD2 (suggested value - 2) 'LSP Database
version mismatch', and close the PCEP session.
If state synchronization is required, then prior to completing the
initialization phase, the PCE MUST mark any LSPs in the LSP database
that were previously reported by the PCC as stale. When the PCC
reports an LSP during state synchronization, if the LSP already
exists in the LSP database, the PCE MUST update the LSP database and
clear the stale marker from the LSP. When it has finished state
synchronization, the PCC MUST immediately send an end of
synchronization marker. The end of synchronization marker is a Path
Computation State Report (PCRpt) message with an LSP object
containing a PLSP-ID of 0 and with the SYNC flag set to 0
([I-D.ietf-pce-stateful-pce]). The LSP-DB-VERSION TLV MUST be
included in this PCRpt message. On receiving this state report, the
PCE MUST purge any LSPs from the LSP database that are still marked
as stale.
Note that a PCE/PCC MAY force state synchronization by not including
the LSP-DB-VERSION TLV in its OPEN object.
Since a PCE does not make changes to the LSP State Database Version
Number, a PCC should never encounter this TLV in a message from the
PCE (other than the OPEN message). A PCC SHOULD ignore the LSP-DB-
VERSION TLV, were it to receive one from a PCE.
Figure 1 shows an example sequence where the state synchronization is
skipped.
Crabbe, et al. Expires September 28, 2017 [Page 6]
Internet-Draft Optimizations of state synchronization March 2017
+-+-+ +-+-+
|PCC| |PCE|
+-+-+ +-+-+
| |
|--Open--, |
| DBv=42 \ ,---Open--|
| S=1 \ / DBv=42 |
| \/ S=1 |
| /\ |
| / `-------->| (OK to skip sync)
(Skip sync) |<--------` |
| . |
| . |
| . |
| |
|--PCRpt,DBv=43,SYNC=0-->| (Regular
| | LSP State Report)
|--PCRpt,DBv=44,SYNC=0-->| (Regular
| | LSP State Report)
|--PCRpt,DBv=45,SYNC=0-->|
| |
Figure 1: State Synchronization Skipped
Figure 2 shows an example sequence where the state synchronization is
performed due to LSP state database version mismatch during the PCEP
session setup. Note that the same state synchronization sequence
would happen if either the PCC or the PCE would not include the LSP-
DB-VERSION TLV in their respective Open messages.
Crabbe, et al. Expires September 28, 2017 [Page 7]
Internet-Draft Optimizations of state synchronization March 2017
+-+-+ +-+-+
|PCC| |PCE|
+-+-+ +-+-+
| |
|--Open--, |
| DBv=46 \ ,---Open--|
| S=1 \ / DBv=42 |
| \/ S=1 |
| /\ |
| / `-------->| (Expect sync)
(Do sync) |<--------` |
| |
|--PCRpt,DBv=46,SYNC=1-->| (Sync start)
| . |
| . |
| . |
|--PCRpt,DBv=46,SYNC=0-->| (Sync done)
| . |(Purge LSP State
| . | if applicable)
| . |
|--PCRpt,DBv=47,SYNC=0-->| (Regular
| | LSP State Report)
|--PCRpt,DBv=48,SYNC=0-->| (Regular
| | LSP State Report)
|--PCRpt,DBv=49,SYNC=0-->|
| |
Figure 2: State Synchronization Performed
Figure 3 shows an example sequence where the state synchronization is
skipped, but because one or both PCEP speakers set the S Flag to 0,
the PCC does not send LSP-DB-VERSION TLVs in subsequent PCRpt
messages to the PCE. If the current PCEP session restarts, the PCEP
speakers will have to perform state synchronization, since the PCE
does not know the PCC's latest LSP State Database Version Number
information.
Crabbe, et al. Expires September 28, 2017 [Page 8]
Internet-Draft Optimizations of state synchronization March 2017
+-+-+ +-+-+
|PCC| |PCE|
+-+-+ +-+-+
| |
|--Open--, |
| DBv=42 \ ,---Open--|
| S=0 \ / DBv=42 |
| \/ S=0 |
| /\ |
| / `-------->| (OK to skip sync)
(Skip sync) |<--------` |
| . |
| . |
| . |
|------PCRpt,SYNC=0----->| (Regular
| | LSP State Report)
|------PCRpt,SYNC=0----->| (Regular
| | LSP State Report)
|------PCRpt,SYNC=0----->|
| |
Figure 3: State Synchronization Skipped, no LSP-DB-VERSION TLVs sent
from PCC
3.2.1. IP Address change during session re-establishment
There could be a case during PCEP session re-establishment when the
PCC's or PCE's IP address can change. This includes, but is not
limited to, the following cases:
o A PCC could use a physical interface IP address to connect to the
PCE. In this case, if the line card that the PCC connects from
changes, then the PCEP session goes down and comes back up again,
with a different IP address associated with a new line card.
o The PCC or PCE may move in the network, either physically or
logically, which may cause its IP address to change. For example,
the PCE may be deployed as a virtual network function (VNF) and
another virtualized instance of the PCE may be populated with the
original PCE instance's state, but be given a different IP
address.
To ensure that a PCEP peer can recognize a previously connected peer,
each PCEP peer includes the SPEAKER-ENTITY-ID TLV described in
Section 3.3.2, in the OPEN message.
Crabbe, et al. Expires September 28, 2017 [Page 9]
Internet-Draft Optimizations of state synchronization March 2017
This TLV is used during the state synchronization procedure to
identify the PCEP session as a re-establishment of a previous session
that went down. Then state synchronization optimizations such as
state sync avoidance can be applied to this session. Note that this
usage is only applicable within the State Timeout Interval
[I-D.ietf-pce-stateful-pce]. After the State Timeout Interval
expires, all state associated with the PCEP session is removed, which
includes the SPEAKER-ENTITY-ID received. Note that the PCEP session
initialization [RFC5440] procedure remains unchanged.
3.3. PCEP Extensions
A new INCLUDE-DB-VERSION (S) bit is added in the stateful
capabilities TLV (see Section 7 for details).
3.3.1. LSP State Database Version Number TLV
The LSP State Database Version Number (LSP-DB-VERSION) TLV is an
optional TLV that MAY be included in the OPEN object and the LSP
object.
This TLV is included in the LSP object in the PCRpt message to
indicate the LSP DB version at the PCC. This TLV SHOULD NOT be
included in other PCEP messages (PCUpd, PcReq, PCRep) and MUST be
ignored if received.
The format of the LSP-DB-VERSION TLV is shown in the following
figure:
0 1 2 3
0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
| Type=TBD5 | Length=8 |
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
| LSP State DB Version Number |
| |
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
Figure 4: LSP-DB-VERSION TLV format
The type of the TLV is TBD5 and it has a fixed length of 8 octets.
The value contains a 64-bit unsigned integer, carried in network byte
order, representing the LSP State DB Version Number.
Crabbe, et al. Expires September 28, 2017 [Page 10]
Internet-Draft Optimizations of state synchronization March 2017
3.3.2. Speaker Entity Identifier TLV
The Speaker Entity Identifier TLV (SPEAKER-ENTITY-ID) is an optional
TLV that MAY be included in the OPEN Object when a PCEP speaker
wishes to determine if state synchronization can be skipped when a
PCEP session is restarted. It contains a unique identifier for the
node that does not change during the lifetime of the PCEP speaker.
It identifies the PCEP speaker to its peers even if the speaker's IP
address is changed.
In case of a remote peer IP address change, a PCEP speaker would
learn the speaker entity identifier on receiving the open message but
it MAY have already sent its open message without realizing that it
is a known PCEP peer. In such a case, either a full synchronization
is done or PCEP session is terminated. This may be a local policy
decision. The new IP address is associated with the speaker entity
identifier for future either way. In the latter case when PCEP
session is re-established, it would be correctly associated with
speaker entity identifier and not be considered as an unknown peer.
The format of the SPEAKER-ENTITY-ID TLV is shown in the following
figure:
0 1 2 3
0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
| Type=TBD13 | Length (variable) |
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
| |
// Speaker Entity Identifier //
| |
+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+
Figure 5: SPEAKER-ENTITY-ID TLV format
The type of the TLV is TBD13 and it has a variable length, which MUST
be greater than 0. The Value is padded to 4-octet alignment. The
padding is not included in the Length field. The value contains the
entity identifier of the speaker transmitting this TLV. This
identifier is required to be unique within its scope of visibility,
which is usually limited to a single domain. It MAY be configured by
the operator. Alternatively, it can be derived automatically from a
suitably-stable unique identifier, such as a MAC address, serial
number, Traffic Engineering Router ID, or similar. In the case of
Crabbe, et al. Expires September 28, 2017 [Page 11]
Internet-Draft Optimizations of state synchronization March 2017
inter-domain connections, the speaker SHOULD prefix its usual
identifier with the domain identifier of its residence, such as
Autonomous System number, IGP area identifier, or similar to make
sure it remains unique.
The relationship between this identifier and entities in the Traffic
Engineering database is intentionally left undefined.
From a manageability point of view, a PCE or PCC implementation
SHOULD allow the operator to configure this Speaker Entity
Identifier.
If a PCEP speaker receives the SPEAKER-ENTITY-ID on a new PCEP
session, that matches with an existing alive PCEP session, the PCEP
speaker MUST send a PCErr with Error-type 20 Error-value TBD7
(suggested value - 7) 'Received an invalid Speaker Entity
Identifier', and close the PCEP session.
4. Incremental State Synchronization
[I-D.ietf-pce-stateful-pce] describes the LSP state synchronization
mechanism between PCCs and stateful PCEs. During the state
synchronization, a PCC sends the information of all its LSPs (i.e.,
the full LSP-DB) to the stateful PCE. In order to reduce the state
synchronization overhead when there is a small number of LSP state
change in the network between PCEP session restart, this section
defines a mechanism for incremental (Delta) LSP Database (LSP-DB)
synchronization.
4.1. Motivation
According to [I-D.ietf-pce-stateful-pce], if a PCE restarts and its
LSP-DB survived, PCCs with mismatched LSP State Database Version
Number will send all their LSPs information (full LSP-DB) to the
stateful PCE, even if only a small number of LSPs underwent state
change. It can take a long time and consume large communication
channel bandwidth.
Figure 6 shows an example of LSP state synchronization.
Crabbe, et al. Expires September 28, 2017 [Page 12]
Internet-Draft Optimizations of state synchronization March 2017
+-----+
| PCE |
+-----+
/
/
/
/
+------+ +------+
| PCC1 |------------| PCC2 |
+------+ +------+
| |
| |
+------+ +------+
| PCC3 |------------| PCC4 |
+------+ +------+
Figure 6: Topology Example
Assuming there are 320 LSPs in the network, with each PCC having 80
LSPs. During the time when the PCEP session is down, 20 LSPs of each
PCC (i.e., 80 LSPs in total), are changed. Hence when PCEP session
restarts, the stateful PCE needs to synchronize 320 LSPs with all
PCCs. But actually, 240 LSPs stay the same. If performing full LSP
state synchronization, it can take a long time to carry out the
synchronization of all LSPs. It is especially true when only a low
bandwidth communication channel is available (e.g., in-band control
channel for optical transport networks) and there is a substantial
number of LSPs in the network. Another disadvantage of full LSP
synchronization is that it is a waste of communication bandwidth to
perform full LSP synchronization given the fact that the number of
LSP changes can be small during the time when PCEP session is down.
An incremental (Delta) LSP Database (LSP-DB) state synchronization is
described in this section, where only the LSPs underwent state change
are synchronized between the session restart. This may include
new/modified/deleted LSPs.
4.2. Incremental Synchronization Procedure
[I-D.ietf-pce-stateful-pce] describes state synchronization and
Section 3 of this document, describes state synchronization avoidance
by using LSP-DB-VERSION TLV in its OPEN object. This section extends
this idea to only synchronize the delta (changes) in case of version
mismatch.
Crabbe, et al. Expires September 28, 2017 [Page 13]
Internet-Draft Optimizations of state synchronization March 2017
If both PCEP speakers include the LSP-DB-VERSION TLV in the OPEN
object and the LSP-DB-VERSION TLV values match, the PCC MAY skip
state synchronization. Otherwise, the PCC MUST perform state
synchronization. Incremental State synchronization capability is
advertised on a PCEP session during session startup using the DELTA-
LSP-SYNC-CAPABILITY (D) bit in the capabilities TLV (see Section 7).
Instead of dumping full LSP-DB to the stateful PCE again, the PCC
synchronizes the delta (changes) as described in Figure 7 when D flag
and S flag is set to 1 by both PCC and PCE. Other combinations of D
and S flags setting by PCC and PCE result in full LSP-DB
synchronization procedure as described in
[I-D.ietf-pce-stateful-pce]. By setting the D flag to zero in the
OPEN message, a PCEP speaker can skip the incremental synchronization
optimization, resulting in a full LSP DB synchronization.
Crabbe, et al. Expires September 28, 2017 [Page 14]
Internet-Draft Optimizations of state synchronization March 2017
+-+-+ +-+-+
|PCC| |PCE|
+-+-+ +-+-+
| |
|--Open--, |
| DBv=46 \ ,---Open--|
| S=1 \ / DBv=42 |
| D=1 \/ S=1 |
| /\ D=1 |
| / \ |
| / `-------->| (Expect Delta sync)
(Do sync)|<--------` | (DONOT Purge LSP
(Delta) | | State)
| |
(Delta Sync starts) |--PCRpt,DBv=46,SYNC=1-->|
| . |
| . |
| . |
| . |
|--PCRpt,DBv=46,SYNC=0-->| (Sync done,
| | PLSP-ID=0)
| |
|--PCRpt,DBv=47,SYNC=0-->| (Regular
| | LSP State Report)
|--PCRpt,DBv=48,SYNC=0-->| (Regular
| | LSP State Report)
|--PCRpt,DBv=49,SYNC=0-->|
| |
Figure 7: Incremental Synchronization Procedure
As per Section 3, the LSP State Database Version Number is
incremented each time a change is made to the PCC's local LSP State
Database. Each LSP is associated with the DB version at the time of
its state change. This is needed to determine which LSP and what
information needs to be synchronized in incremental state
synchronization. The incremental state sync is done from the last
LSP DB version received by the PCE to the latest DB version at the
PCC. Note that the LSP State Database Version Number can wrap
around, and in which case the incremental state sync would also wrap
till the latest DB version number at the PCC.
In order to carry out incremental state synchronization, it is not
necessary for a PCC to store a complete history of LSP Database
Crabbe, et al. Expires September 28, 2017 [Page 15]
Internet-Draft Optimizations of state synchronization March 2017
change for all time, but remember the LSP state changes (including
LSP modification, setup and deletion), that the PCE did not get to
process during the session down. Note that, a PCC would be unaware
that a particular LSP report has been processed by the PCE before the
session to PCE went down. So a PCC implementation MAY choose to
store the LSP State Database Version Number with each LSP at the time
its status changed, so that when a session is re-established an
incremental synchronization can be attempted based on the PCE's last
LSP State Database Version Number. For an LSP that is deleted at the
PCC, the PCC implementation would need to remember the deleted LSP in
some way to make sure this could be reported as part of incremental
synchronization later. The PCC would discard this information based
on a local policy, or when it determines that this information is no
longer needed with sufficient confidence. In the example shown in
Figure 7, the PCC needs to store the LSP state changes that happened
between DB Version 43 to 46 and synchronizes these changes, when
performing incremental LSP state update.
If a PCC finds out it does not have sufficient information to
complete incremental synchronization after advertising incremental
LSP state synchronization capability, it MUST send a PCErr with
Error-Type 20 and Error-Value 5 'A PCC indicates to a PCE that it can
not complete the state synchronization' (defined in
[I-D.ietf-pce-stateful-pce]) and terminate the session. The PCC
SHOULD re-establish the session with the D bit set to 0 in the OPEN
message.
The other procedures and error checks remain unchanged from the full
state synchronization ([I-D.ietf-pce-stateful-pce]).
5. PCE-triggered Initial Synchronization
5.1. Motivation
In networks such as optical transport networks, the control channel
between network nodes can be realized through in-band overhead thus
has limited bandwidth. With a stateful PCE connected to the network
via one network node, it is desirable to control the timing of PCC
state synchronization so as not to overload the low communication
channel available in the network during the initial synchronization
(be it incremental or full) when the session restarts , when there is
comparatively large amount of control information needing to be
synchronized between the stateful PCE and the network. The method
proposed, i.e., allowing PCE to trigger the state synchronization, is
similar to the function proposed in Section 6 but is used in
different scenarios and for different purposes.
Crabbe, et al. Expires September 28, 2017 [Page 16]
Internet-Draft Optimizations of state synchronization March 2017
5.2. PCE-triggered Initial State Synchronization Procedure
Support of PCE-triggered initial state synchronization is advertised
during session startup using the TRIGGERED-INITIAL-SYNC (F) bit in
the STATEFUL-PCE-CAPABILITY TLV (see Section 7).
In order to allow a stateful PCE to control the LSP-DB
synchronization after establishing a PCEP session, both PCEP speakers
MUST set F bit to 1 in the OPEN message. If the LSP-DB-VERSION TLV
is included by both PCEP speakers and the TLV value matches, the
state synchronization can be skipped as described in Section 3.2. If
the TLV is not included or the LSP-DB Version is mis-matched, the PCE
can trigger the state synchronization process by sending a PCUpd
message with PLSP-ID = 0 and SYNC = 1. The PCUpd message SHOULD
include an empty ERO (with no ERO sub-object and object length of 4)
as its intended path and SHOULD NOT include the optional objects for
its attributes for any parameter update. The PCC MUST ignore such an
update when the SYNC flag is set. If the TRIGGERED-INITIAL-SYNC
capability is not advertised by a PCE and the PCC receives a PCUpd
with the SYNC flag set to 1, the PCC MUST send a PCErr with the SRP-
ID-number of the PCUpd, Error-Type 20 and Error-Value TBD4 (suggested
value - 4) 'Attempt to trigger synchronization when the TRIGGERED-
SYNC capability has not been advertised' (see Section 8.1). If the
TRIGGERED-INITIAL-SYNC capability is advertised by a PCE and the PCC,
the PCC MUST NOT trigger state synchronization on its own. If the
PCE receives a PCRpt message before the PCE has triggered the state
synchronization, the PCE MUST send a PCErr with Error-Type 20 and
Error-Value TBD3 (suggested value - 3) 'Attempt to trigger
synchronization before PCE trigger' (see Section 8.1).
In this way, the PCE can control the sequence of LSP synchronization
among all the PCCs that are re-establishing PCEP sessions with it.
When the capability of PCE control is enabled, only after a PCC
receives this message, it will start sending information to the PCE.
This PCE-triggering capability can be applied to both full and
incremental state synchronization. If applied to the latter, the
PCCs only send information that PCE does not possess, which is
inferred from the LSP-DB version information exchanged in the OPEN
message (see Section 4.2 for detailed procedure).
Once the initial state synchronization is triggered by the PCE, the
procedures and error checks remain unchanged
([I-D.ietf-pce-stateful-pce]).
If a PCC implementation that does not implement this extension should
not receive a PCUpd message to trigger state synchronization as per
the capability advertisement, but if it were to receive it, it will
behave as per [I-D.ietf-pce-stateful-pce].
Crabbe, et al. Expires September 28, 2017 [Page 17]
Internet-Draft Optimizations of state synchronization March 2017
6. PCE-triggered Re-synchronization
6.1. Motivation
The accuracy of the computations performed by the PCE is tied to the
accuracy of the view the PCE has on the state of the LSPs.
Therefore, it can be beneficial to be able to re-synchronize this
state even after the session has been established. The PCE may use
this approach to continuously sanity check its state against the
network, or to recover from error conditions without having to tear
down sessions.
6.2. PCE-triggered State Re-synchronization Procedure
Support of PCE-triggered state re-synchronization is advertised by
both PCEP speakers during session startup using the TRIGGERED-RESYNC
(T) bit in the STATEFUL-PCE-CAPABILITY TLV (see Section 7). The PCE
can choose to re-synchronize its entire LSP database or a single LSP.
To trigger re-synchronization for an LSP, the PCE sends a Path
Computation State Update (PCUpd) for the LSP, with the SYNC flag in
the LSP object set to 1. The PCE SHOULD NOT include any parameter
updates for the LSP, and the PCC MUST ignore such an update when the
SYNC flag is set. The PCC MUST respond with a PCRpt message with the
LSP state, SYNC Flag set to 0 and MUST include the SRP-ID-number of
the PCUpd message that triggered the resynchronization. If the PCC
cannot find the LSP in its database, PCC MUST also set the R (remove)
flag [I-D.ietf-pce-stateful-pce] in the LSP object in the PCRpt
message.
The PCE can also trigger re-synchronization of the entire LSP
database. The PCE MUST first mark all LSPs in the LSP database that
were previously reported by the PCC as stale and then send a PCUpd
with an LSP object containing a PLSP-ID of 0 and with the SYNC flag
set to 1. The PCUpd message MUST include an empty ERO (with no ERO
sub-object and object length of 4) as its intended path and SHOULD
NOT include the optional objects for its attributes for any parameter
update. The PCC MUST ignore such update if the SYNC flag is set.
This PCUpd message is the trigger for the PCC to enter the
synchronization phase as described in [I-D.ietf-pce-stateful-pce] and
start sending PCRpt messages. After the receipt of the end-of-
synchronization marker, the PCE will purge LSPs which were not
refreshed. The SRP-ID-number of the PCUpd that triggered the re-
synchronization SHOULD be included in each of the PCRpt messages. If
the PCC cannot re-synchronize the entire LSP database, the PCC MUST
respond with PCErr message with Error-type 20 Error-value 5 'cannot
complete the state synchronization' [I-D.ietf-pce-stateful-pce], and
MAY terminate the session. The PCE MUST remove the stale mark for
Crabbe, et al. Expires September 28, 2017 [Page 18]
Internet-Draft Optimizations of state synchronization March 2017
the LSP that were previously reported by the PCC. Based on the local
policy, the PCE MAY reattempt synchronization at a later time.
If the TRIGGERED-RESYNC capability is not advertised by a PCE and the
PCC receives a PCUpd with the SYNC flag set to 1, it MUST send a
PCErr with the SRP-ID-number of the PCUpd, Error-Type 20 and Error-
Value TBD4 (suggested value - 4) 'Attempt to trigger synchronization
when the TRIGGERED-SYNC capability has not been advertised' (see
Section 8.1).
Once the state re-synchronization is triggered by the PCE, the
procedures and error checks remain unchanged from the full state
synchronization ([I-D.ietf-pce-stateful-pce]). This would also
include PCE triggering multiple state re-synchronization requests
while synchronization is in progress.
If a PCC implementation that does not implement this extension should
not receive a PCUpd message to trigger re-synchronization as per the
capability advertisement, but if it were to receive it, it will
behave as per [I-D.ietf-pce-stateful-pce].
7. Advertising Support of Synchronization Optimizations
Support for each of the optimizations described in this document
requires advertising the corresponding capabilities during session
establishment time.
The STATEFUL-PCE-CAPABILITY TLV is defined in
[I-D.ietf-pce-stateful-pce]. This document defines following new
flags in the STATEFUL-PCE-CAPABILITY TLV:
Bit Description
TBD9 (suggested value 30) S bit (INCLUDE-DB-VERSION)
TBD10 (suggested value 27) D bit (DELTA-LSP-SYNC-CAPABILITY)
TBD11 (suggested value 26) F bit (TRIGGERED-INITIAL-SYNC)
TBD12 (suggested value 28) T bit (TRIGGERED-RESYNC)
If the S (INCLUDE-DB-VERSION) bit is set to 1 by both PCEP Speakers,
the PCC will include the LSP-DB-VERSION TLV in each LSP Object. See
Section 3.2 for details.
If the D (DELTA-LSP-SYNC-CAPABILITY) bit is set to 1 by a PCEP
speaker, it indicates that the PCEP speaker allows incremental
(delta) state synchronization. See Section 4.2 for details.
If the F (TRIGGERED-INITIAL-SYNC) bit is set to 1 by both PCEP
Speakers, the PCE SHOULD trigger initial (first) state
synchronization. See Section 5.2 for details.
Crabbe, et al. Expires September 28, 2017 [Page 19]
Internet-Draft Optimizations of state synchronization March 2017
If the T (TRIGGERED-RESYNC) bit is set to 1 by both PCEP Speakers,
the PCE can trigger re-synchronization of LSPs at any point in the
life of the session. See Section 6.2 for details.
See Section 8.3 for IANA allocations.
8. IANA Considerations
This document requests IANA actions to allocate code points for the
protocol elements defined in this document.
8.1. PCEP-Error Object
IANA is requested to make the following allocation in the "PCEP-ERROR
Object Error Types and Values" registry.
Error-Type Meaning Reference
6 Mandatory Object missing [RFC5440]
Error-Value= TBD1(suggested This document
value 12): LSP-DB-VERSION TLV
missing
20 LSP State synchronization [I-D.ietf-pce-stateful-pce]
error
Error-Value= TBD2(suggested This document
value 2): LSP Database version
mismatch.
Error-Value=TBD3(suggested This document
value 3): Attempt to trigger
synchronization before PCE
trigger.
Error-Value=TBD4(suggested This document
value 4): Attempt to trigger a
synchronization when the
PCE triggered synchronization
capability has not been
advertised.
Error-Value=TBD6(suggested This document
value 6): Received an invalid
LSP DB Version Number.
Error-Value=TBD7(suggested This document
value 7): Received an invalid
Speaker Entity Identifier.
Crabbe, et al. Expires September 28, 2017 [Page 20]
Internet-Draft Optimizations of state synchronization March 2017
8.2. PCEP TLV Type Indicators
IANA is requested to make the following allocation in the "PCEP TLV
Type Indicators" registry.
Value Meaning Reference
TBD5(suggested value 23) LSP-DB-VERSION This document
TBD13(suggested value 24) SPEAKER-ENTITY-ID This document
8.3. STATEFUL-PCE-CAPABILITY TLV
The STATEFUL-PCE-CAPABILITY TLV is defined in
[I-D.ietf-pce-stateful-pce] and a registry is requested to be
created to manage the flags in the TLV. IANA is requested to make
the following allocation in the aforementioned registry.
Bit Description Reference
TBD11 (suggested value 26) TRIGGERED-INITIAL-SYNC This document
TBD10 (suggested value 27) DELTA-LSP-SYNC-CAPABILITY This document
TBD12 (suggested value 28) TRIGGERED-RESYNC This document
TBD9 (suggested value 30) INCLUDE-DB-VERSION This document
9. Manageability Considerations
All manageability requirements and considerations listed in [RFC5440]
and [I-D.ietf-pce-stateful-pce] apply to PCEP protocol extensions
defined in this document. In addition, requirements and
considerations listed in this section apply.
9.1. Control of Function and Policy
A PCE or PCC implementation MUST allow configuring the state
synchronization optimization capabilities as described in this
document. The implementation SHOULD also allow the operator to
configure the Speaker Entity Identifier ( Section 3.3.2). Further,
the operator SHOULD be to be allowed to trigger the re-
synchronization procedures as per Section 6.2.
9.2. Information and Data Models
An implementation SHOULD allow the operator to view the stateful
capabilities advertised by each peer, and the current synchronization
status with each peer. To serve this purpose, the PCEP YANG module
[I-D.ietf-pce-pcep-yang] can be extended to include advertised
stateful capabilities, and synchronization status.
Crabbe, et al. Expires September 28, 2017 [Page 21]
Internet-Draft Optimizations of state synchronization March 2017
9.3. Liveness Detection and Monitoring
Mechanisms defined in this document do not imply any new liveness
detection and monitoring requirements in addition to those already
listed in [RFC5440].
9.4. Verify Correct Operations
Mechanisms defined in this document do not imply any new operation
verification requirements in addition to those already listed in
[RFC5440] and [I-D.ietf-pce-stateful-pce].
9.5. Requirements On Other Protocols
Mechanisms defined in this document do not imply any new requirements
on other protocols.
9.6. Impact On Network Operations
Mechanisms defined in [RFC5440] and [I-D.ietf-pce-stateful-pce] also
apply to PCEP extensions defined in this document.
The state synchronization optimizations described in this document
can result in a reduction of the amount of data exchanged and the
time taken for a stateful PCE to be fully operational when a PCEP
session is re-established. The ability to trigger re-synchronization
by the PCE can be utilized by the operator to sanity check its state
and recover from any mismatch in state without tearing down the
session.
10. Security Considerations
The security considerations listed in [I-D.ietf-pce-stateful-pce]
apply to this document as well. However, this document also
introduces some new attack vectors. An attacker could spoof the
SPEAKER-ENTITY-ID and pretend to be another PCEP speaker. An
attacker may flood the PCC with triggered re-synchronization request
at a rate which exceeds the PCC's ability to process them, either by
spoofing messages or by compromising the PCE itself. The PCC can
respond with PCErr message as described in Section 6.2 and terminate
the session. Thus securing the PCEP session using Transport Layer
Security (TLS) [I-D.ietf-pce-pceps], as per the recommendations and
best current practices in [RFC7525], is RECOMMENDED. An
administrator could also expose the speaker entity id as part of the
certificate, for the peer identity verification.
Crabbe, et al. Expires September 28, 2017 [Page 22]
Internet-Draft Optimizations of state synchronization March 2017
11. Acknowledgments
We would like to thank Young Lee, Sergio Belotti and Cyril Margaria
for their comments and discussions.
Thanks to Jonathan Hardwick for being the document shepherd and
provide comments and guidance.
Thanks to Tomonori Takeda for Routing Area Directorate review.
Thanks to Adrian Farrel for TSVART review and providing detailed
comments and suggestions.
Thanks to Daniel Franke for SECDIR review.
Thanks to Alvaro Retana, Kathleen Moriarty, and Stephen Farrell for
comments during the IESG evaluation.
Thanks to Deborah Brungard for being the responsible AD and guiding
the authors as needed.
12. Contributors
Gang Xie
Huawei Technologies
F3-5-B R&D Center, Huawei Industrial Base, Bantian, Longgang District
Shenzhen, Guangdong, 518129
P.R. China
Email: xiegang09@huawei.com
13. References
13.1. Normative References
[I-D.ietf-pce-stateful-pce]
Crabbe, E., Minei, I., Medved, J., and R. Varga, "PCEP
Extensions for Stateful PCE", draft-ietf-pce-stateful-
pce-18 (work in progress), December 2016.
[RFC2119] Bradner, S., "Key words for use in RFCs to Indicate
Requirement Levels", BCP 14, RFC 2119,
DOI 10.17487/RFC2119, March 1997,
<http://www.rfc-editor.org/info/rfc2119>.
[RFC5440] Vasseur, JP., Ed. and JL. Le Roux, Ed., "Path Computation
Element (PCE) Communication Protocol (PCEP)", RFC 5440,
DOI 10.17487/RFC5440, March 2009,
<http://www.rfc-editor.org/info/rfc5440>.
Crabbe, et al. Expires September 28, 2017 [Page 23]
Internet-Draft Optimizations of state synchronization March 2017
13.2. Informative References
[RFC7525] Sheffer, Y., Holz, R., and P. Saint-Andre,
"Recommendations for Secure Use of Transport Layer
Security (TLS) and Datagram Transport Layer Security
(DTLS)", BCP 195, RFC 7525, DOI 10.17487/RFC7525, May
2015, <http://www.rfc-editor.org/info/rfc7525>.
[RFC8051] Zhang, X., Ed. and I. Minei, Ed., "Applicability of a
Stateful Path Computation Element (PCE)", RFC 8051,
DOI 10.17487/RFC8051, January 2017,
<http://www.rfc-editor.org/info/rfc8051>.
[I-D.ietf-pce-pcep-yang]
Dhody, D., Hardwick, J., Beeram, V., and j.
jefftant@gmail.com, "A YANG Data Model for Path
Computation Element Communications Protocol (PCEP)",
draft-ietf-pce-pcep-yang-02 (work in progress), March
2017.
[I-D.ietf-pce-pceps]
Lopez, D., Dios, O., Wu, W., and D. Dhody, "Secure
Transport for PCEP", draft-ietf-pce-pceps-11 (work in
progress), January 2017.
Authors' Addresses
Edward Crabbe
Oracle
EMail: edward.crabbe@gmail.com
Ina Minei
Google, Inc.
1600 Amphitheatre Parkway
Mountain View, CA 94043
US
EMail: inaminei@google.com
Crabbe, et al. Expires September 28, 2017 [Page 24]
Internet-Draft Optimizations of state synchronization March 2017
Jan Medved
Cisco Systems, Inc.
170 West Tasman Dr.
San Jose, CA 95134
US
EMail: jmedved@cisco.com
Robert Varga
Pantheon Technologies SRO
Mlynske Nivy 56
Bratislava 821 05
Slovakia
EMail: robert.varga@pantheon.tech
Xian Zhang
Huawei Technologies
F3-5-B R&D Center, Huawei Industrial Base, Bantian, Longgang District
Shenzhen, Guangdong 518129
P.R.China
EMail: zhang.xian@huawei.com
Dhruv Dhody
Huawei Technologies
Divyashree Techno Park, Whitefield
Bangalore, Karnataka 560066
India
EMail: dhruv.ietf@gmail.com
Crabbe, et al. Expires September 28, 2017 [Page 25]