Meeting 2020-04-22

Attendees

  • Brian
  • Derek
  • John
  • Soundar

Updates

XRootD TCP statistics

  • Andy merged the changes to master
  • Hook will track disconnects only at this point
  • Derek will develop plugin (shared library)
    • Will send jstream (JSON) packets rather than binary

HTCondor monitoring and emails

  • Derek will send weekly emails to SAND team list

ESnet data

  • Working on refactoring and testing
  • Soundar will work with Ilija to add a unique record ID for duplicate detection

Tape replay

  • Now sending Jan 2019
  • Will add replay overview writeup to website
  • Add a messages per second graph

Ongoing topics

XRootD TCP statistics

  • Andy wrote plugin infrastructure, to be merged in XRootD v5
  • Will require a plugin (shared library) to be developed

ESnet data

  • Collector on github
  • Uses Netbeam API
  • Have access to SNMP (over 9022 interfaces)
  • Data: traffic (2 years); errors, discards (1 month)
  • Size: About 1GB/mo
  • Working on reviewing schema and moving into production
  • Don’t send to tape now. Wait until we’re ready to move to production.

Sending HTCondor data to both ES instances

  • Chicago ES is newer, and plans to use newer features (ILM)
  • This incompatible with ES on the older GRACC instance
  • Should the data go to tape? Est. around couple hundred MB/day
    • Consensus is yes!

Case studies

  • U Waterloo writeup is complete
  • Purdue/FNAL, Madison, and throughput writeup is in progress
  • Make a recorded session
  • Convert into webpage, add to SAND website (John)

Updated: