HomeGuidesAPI Reference
Guides

After Maintenance Window Checklist

Verify critical site and EdgeConnect connectivity, then capture the same artifacts you captured in the Before Maintenance Window Checklist and compare. The sections below are in the same order as the before page.

📘

Let the fabric settle before you capture. Field practice: wait 5 minutes; if tunnels are not yet up, wait another 10-15. Judge readiness on tunnel status, not the clock. A flow or route capture taken too early will show differences that are still converging.

Gather Organization Resources

Alert the following that they can begin validation testing:

  • USER 1
  • USER 2
  • USER 3
  • USER 4
  • SME APP 1
  • SME APP 2
  • SME APP 3
  • SME APP 4

What goes in the folder

Same filenames as the before folder, saved to after. Where a filename starts with hostname, use that EdgeConnect's hostname.

ArtifactWhereFilename
Orchestrator active alarmsAlarms > Activeorch-alarms (export or screenshot)
ReachabilityMonitoring > Reachabilityreachability (export or screenshot)
NMS alarms and down devicesEnterprise NMSnms-alarms, nms-down-devices
Tunnels - overlayConfiguration > Tunnels > Overlaytunnels-report-overlay.csv
Tunnels - underlayConfiguration > Tunnels > Underlaytunnels-report-underlay.csv
Tunnels - passthroughConfiguration > Tunnels > Passthroughtunnels-report-passthrough.csv
Routes - Method 1 (all gateways)Configuration > Routesroutes-report.csv
Routes - Method 2 (per gateway)Configuration > Routeshostname_routes_report.csv
BGP summaryConfiguration > BGP > Summarybgp-summary-report.csv
BGP peersConfiguration > BGP > Peersbgp-peers-report.csv
OSPF stateConfiguration > OSPFospf-report (export or screenshot)
Flows - hubs and critical spokesMonitoring > Active & Recent Flowshostname_flows.csv
Configuration backupAdministration > Backup NowHeld in Orchestrator, comment After outage (change control number)
Application test evidenceFlow details, app performance statshostname_app_flows.csv, screenshots

Orchestrator Alarms and Reachability

  • Navigate to: Alarms > Active
  • Export or screenshot, save to after as orch-alarms
  • Compare with the before capture
    • Investigate unexpected alarms
    • Limit this to one or two people to prevent clearing alarms that may be critical
  • Navigate to: Monitoring > Reachability
  • Note any "Not connected" EdgeConnect gateways - compare with before
  • Verify connected gateways are reachable (via both Orchestrator and Portal websockets)
  • Export or screenshot, save to after as reachability

Enterprise NMS Tools - State Capture

  • Remove maintenance mode from the devices you set before the window
  • Any down sites?
  • Any down devices?
  • Any new alarms?
  • Export or screenshot the state details, save to after as nms-alarms and nms-down-devices
  • Compare with before

Tunnel States

  • Select all gateways
  • Navigate to: Configuration > Tunnels
  • Select "Overlay", click "Export", save to after as tunnels-report-overlay
  • Select "Underlay", click "Export", save to after as tunnels-report-underlay
  • Select "Passthrough", click "Export", save to after as tunnels-report-passthrough
  • Compare the exports and/or screenshots with before, starting with the critical sites
    • Approximately the same number up?
    • Approximately the same number down?
    • Are any tunnels down that were previously up-active?
      • Verify traffic is not using a different tunnel
      • Verify there are still some tunnels between these devices

Edge Connect Route Verification

❗️

Follow the same method you chose before the window. Method #1 and Method #2 exports cannot be compared against each other.

Method #1 - Global report including all gateways (single CSV file)

  • Select all gateways in the navigation tree
  • Navigate to Configuration > Routes
  • Ensure "All" is selected and all filters are cleared
  • Choose "Export"
  • Save to after as routes-report.csv

Method #2 - Single report for each gateway (multiple CSVs)

  • Select one gateway in the navigation tree
  • Navigate to Configuration > Routes
  • Ensure "All" is selected and all filters are cleared
  • Choose "Export"
  • Save to after as hostname_routes_report.csv
  • Repeat for each gateway in the SD-WAN fabric

Compare the route tables

Once you have the routes captured you need to compare them. Depending on the size of your route tables the options are:

  1. Use the Snapshot Sentinel. Drop the before and after routes exports on it and it lists the routes missing after, the routes new after, and the routes whose metric, state or zone changed, per appliance. It runs in your browser with no network, so download it before the window.
  2. Manual comparison
    1. Paste the before and after routes into the same Excel sheet
      1. Use the filter options to remove duplicates
      2. Do you expect the new routes you see?
    2. Compare the raw number of routes
      1. Do the before and after match?
      2. Rarely is this exactly the same, but a difference of more than 5 routes should be investigated
  3. Use an internal script to compare differences
❗️

What a CSV compare cannot see: the routes export drops the P/B (primary/backup) tag and the admin distance that the Routes page shows (GMS-46509). A prefix that flipped from primary to backup looks identical in the CSV. Spot-check P/B in the UI for the critical prefixes at hubs and critical spokes.

BGP and OSPF State Verification

  • Select all gateways in the navigation tree
  • Navigate to Configuration > BGP
  • Choose "Summary" and click "Export", save to after as bgp-summary-report.csv
  • Choose "Peers" and click "Export", save to after as bgp-peers-report.csv
  • Navigate to Configuration > OSPF
  • Export or screenshot the neighbor state, save to after as ospf-report
  • Compare with before - every peer and neighbor that was Established before should be Established now

Flow Table Snapshot (Hubs and Critical Spokes)

  • Select a hub gateway
  • Navigate to Monitoring > Active & Recent Flows
  • Ensure all filters are cleared and the search box is empty
  • Click Export
  • Save to after as hostname_flows.csv
  • Repeat for each hub gateway
  • Repeat for each critical spoke gateway identified before the window
  • Review these flows for things that should not be
    • Reset the bad flows - are they still flowing improperly?
      • Investigate flow details and verify the route taken
      • Verify before and after route maps

Active flow analysis

  • With no flow filter applied and Bytes set to "Total"
    • Sort the flow table by bytes IN - note the number of flows with 0 bytes
    • Sort the flow table by bytes OUT - note the number of flows with 0 bytes
    • Do they match the before counts? Is any difference expected?

Configuration Backup

  • Select all appliances
  • Navigate to: Administration > Backup Now
  • Add comment "After outage (change control number)"
  • Click Backup
  • If you have an issue, use the configuration compare tool in Orchestrator to see what changed between the before and after backups

Test Applications for Function

Test all used applications for voice/video, or at least those "critical" to the organization. Compare each result against the baseline the testers recorded before the window.

💻

Teams, Zoom, Google, VoIP phones, etc.

  • Voice
    • Can call in both directions and get a ring
    • Flows and direction (one method is fine - flow export is easier for large volumes)
      • Flow export - save as EC name - save to after
      • Screenshot - save as EC name - save to after
    • Both parties can hear each other
    • Test all used organization voice applications
    • Compare performance with the before capture - any change in quality?
      • Find internal application performance statistics, screenshot and save to after
  • Video
    • Able to connect a session on organization apps
    • Both parties can see each other
    • Compare performance with the before capture - any change in quality?
      • Find internal application performance statistics, screenshot and save to after
  • App 1-2-3
    • Test application for functions
      • Filter for application flows, export and save to after
      • Screenshot the "Performance" tab in flow details
      • Screenshot the "General" tab in flow details
      • Save the above to after
      • Find internal application performance statistics, screenshot and save to after
    • Ask tester(s) for feedback on performance
      • Compare with what they documented before the window
      • User should do a "full transaction" in the application

Did this page help you?