About SAND

The SAND project coordinates network monitoring and diagnostics from over a hundred application-level measurement points and aggregates them into a measurement archive. This curated measurement archive provides access to historical and quasi-real-time network performance data, allowing for higher-level diagnastics and analyses.

SAND supports and collaborates with long-running activities such as the OSG-Networking area and the WLCG Throughput working group. The data collected by each of these projects goes into the SAND Network Monitoring Archive (SAND-NMA).

SAND maintains a map of CC* sites running perfSONAR; to allow your site to show up, follow these directions.

Sample packet loss graph

Packet Loss Tracking

Sample packet loss graph from the SAND archive

Learn more

Sample TCP throughput graph

Throughput Tracking

SAND’s archives record historical single-stream TCP throughout across many links

Sample Data Collection Rates

Running Data Collection Queries

SAND continuously queries participating perfSONAR endpoints to pull their data into the archive

Learn more

SAND Network Monitoring Archive

The SAND-NMA aims to aggregate as much network monitoring tests results as feasible, providing a knowledgebase for debugging networks and performing data analytics. This archive consists of a data collector (polling measurement endpoints), a message bus (which endpoints can also push data into directly), an archive, and a visualization platform, as pictured here:

SAND-NMA Architecture

SAND-NMA Architecture

Currently, we are recording network measurements from perfSONAR and HTCondor file transfer; we plan to extend this to XRootD services during 2020.

A few metrics about our service:

  • SAND users: SAND is utilized by US ATLAS and US CMS to help debug their network performance.
  • Number of unique data sources: 274
  • Number of HTCondor submit hosts reporting network measurements: 23
  • Number of distinct measurements in the ElasticSearch database: over 2.3 billion

Contact us

SAND has a weekly meeting for collaborators and project members:

When Monday, 3:00–4:00 p.m. Central Time
Online https://unl.zoom.us/j/344520180
Phone +1 646 876 9923,or +1 669 900 6833, Meeting ID: 344 520 180

Additionally, we can be reached via our public Google Group.