Meeting 2020-04-01


  • Brian
  • Derek
  • Ilija
  • John
  • Manjari
  • Petya
  • Shawn
  • Soundar

Presentations from team members

Collection of presentations


  • Systems Developer working with Shawn at Univ. of Michigan, 20% on SAND
  • Collecting network port data from ESNet REST APIs and sending to OSG RabbitMQ bus


  • PhD student at Univ. of Plovdiv
  • Working on data cleanup, analysis, visualization, and anomaly detection
  • Goal is to create alarm tables showing the most significant problems in the network or infrastructure


  • Undergraduate student at Univ. of Michigan
  • Working on analysis of traceroute paths, determining if paths are symmetric between pairs of hosts
  • Repository

Ongoing topics

Sending HTCondor data to both ES instances

  • Chicago ES is newer, and plans to use newer features (ILM)
  • This incompatible with ES on the older GRACC instance
  • Should the data go to tape? Est. around couple hundred MB/day
    • Consensus is yes!

ESnet data

  • Have access to SNMP (over 9022 interfaces)
  • Data: traffic (2 years); errors, discards (1 month)
  • Size: About 1GB/mo
  • Working on reviewing schema and moving into production
  • Don’t send to tape now. Wait until we’re ready to move to production.

Example use cases

  • U Waterloo writeup is complete
  • Purdue/FNAL, Madison, and throughput writeup is in progress
  • Make a recorded session
  • Convert into webpage, add to SAND website (John)

Tape replay

  • Now sending Dec 2018
  • Wrote email of replay overview (John with Derek)

XRootD TCP statistics

  • Andy recommended making a plugin
  • Will likely require quite a bit of plumbing (adding hooks in the right spot)