Storage & Infrastructure Group Overview
1
S
t
o
r
a
g
e
&
I
n
f
r
a
s
t
r
u
c
t
u
r
e
G
r
o
u
p
●
Infrastructure Services
○
Staff members:
■
Joe Frith, Mark Berry, Matt Cowan, Robert Hancock & Tommy Tang
○
Responsibilities:
■
Virtualization & Container management (RHEV, OKD, OpenShift)
■
Central build & config mgmt (Cobbler, Foreman, Puppet)
■
Central storage (GPFS, NFS, AFS, STAR XRootD, Lustre hardware)
■
Central services (IPA/ldap, ntp, ssh, sftp, Globus DTN)
■
IAA services (COmanage, Keycloak)
○
Current Activities:
■
RHEV EoL: migration to OpenShift or VMWare
■
Puppet Upgrade to support RHEL 8/9
■
STAR & ATLAS T3 GPFS hardware upgrade
■
sPHENIX Lustre expansion (hardware/OS install)
■
SDCC IAA merge with ITD AD possibility?
2
S
t
o
r
a
g
e
&
I
n
f
r
a
s
t
r
u
c
t
u
r
e
G
r
o
u
p
●
HPSS Tape Archive
○
Staff members:
■
Tim Chou, Ognian Novakov, Justin Spradley, Iris Wu
○
Responsibilities:
■
Tape libraries, HPSS data movers, core/DB servers, disk cache, FC infrastructures
■
Tape backup services (TSM & TiBS)
■
HPSS Batch
■
HPSS Clients
○
Current Activities:
■
Preparations for sPHENIX Run24 (cosmic run is in progress, collisions on Apr 15)
■
ATLAS data injection and staging
•
1,000 LTO8 (12TB/tape)tapes purchased in Feb, 2024
•
1,150 LTO8 tapes available (13.8PB)
■
TSM upgrade to 8.1.21
■
Repacking of data on older LTO to new LTO media
■
Development of next Batch tape staging
3
S
t
o
r
a
g
e
&
I
n
f
r
a
s
t
r
u
c
t
u
r
e
G
r
o
u
p
●
Storage Services (Large Clustered Storage)
○
Staff members:
■
Jane Liu, Doug Benjamin, Carlos Gamboa, Vincent Garonne, Qiulan Huang, Iris Wu,
James Leonardi
○
Responsibilities:
■
dCache (Belle II, ATLAS, DUNE, PHENIX, preprod testbed)
■
Lustre (sPHENIX, sPHENIX NEW, Three NSLS2 systems, CFN, CSI BNLBOX,
STAR/EIC, ATLAS HPC, CSI SciSever)
○
Current Activities:
■
ATLAS dCache storage pool retirement/replacement
■
SciServer Lustre
■
sPHENIX Lustre expansion (~22PB)
■
Development of Generic Lustre Puppet Modules (including monitoring software) for
RHEL8
4
BNL Directorates
•
NSLS2 – National Synchrotron Light Source
•
CFN – Center for Functional Nanomaterials
•
CSI – Computational Science Initiative
•
EIC – Electron-Ion Collider
The Storage & Infrastructure Group consists of dedicated staff members managing virtualization, container management, central build and configuration, storage services, and IAA services. They are currently involved in various activities such as migrating to OpenShift, upgrading Puppet to support RHEL 8/9, hardware upgrades, Lustre expansion, and possible merges with other departments. Additionally, the HPSS Tape Archive team is responsible for tape libraries, data movers, and backup services, with ongoing activities related to sPHENIX Run24 preparations, ATLAS data staging, and tape upgrades. The Storage Services team focuses on clustered storage solutions, with responsibilities including dCache and Lustre management, as well as developments in storage pool retirement and Lustre expansion.
Download Presentation
Please find below an Image/Link to download the presentation.
The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author.If you encounter any issues during the download, it is possible that the publisher has removed the file from their server.
You are allowed to download the files provided on this website for personal or commercial use, subject to the condition that they are used lawfully. All files are the property of their respective owners.
The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author.
E N D
Presentation Transcript
Storage & Infrastructure Group Infrastructure Services Staff members: Joe Frith, Mark Berry, Matt Cowan, Robert Hancock & Tommy Tang Responsibilities: Virtualization & Container management (RHEV, OKD, OpenShift) Central build & config mgmt (Cobbler, Foreman, Puppet) Central storage (GPFS, NFS, AFS, STAR XRootD, Lustre hardware) Central services (IPA/ldap, ntp, ssh, sftp, Globus DTN) IAA services (COmanage, Keycloak) Current Activities: RHEV EoL: migration to OpenShift or VMWare Puppet Upgrade to support RHEL 8/9 STAR & ATLAS T3 GPFS hardware upgrade sPHENIX Lustre expansion (hardware/OS install) SDCC IAA merge with ITD AD possibility? 2
Storage & Infrastructure Group HPSS Tape Archive Staff members: Tim Chou, Ognian Novakov, Justin Spradley, Iris Wu Responsibilities: Tape libraries, HPSS data movers, core/DB servers, disk cache, FC infrastructures Tape backup services (TSM & TiBS) HPSS Batch HPSS Clients Current Activities: Preparations for sPHENIX Run24 (cosmic run is in progress, collisions on Apr 15) ATLAS data injection and staging 1,000 LTO8 (12TB/tape)tapes purchased in Feb, 2024 1,150 LTO8 tapes available (13.8PB) TSM upgrade to 8.1.21 Repacking of data on older LTO to new LTO media Development of next Batch tape staging 3
Storage & Infrastructure Group Storage Services (Large Clustered Storage) Staff members: Jane Liu, Doug Benjamin, Carlos Gamboa, Vincent Garonne, Qiulan Huang, Iris Wu, James Leonardi Responsibilities: dCache (Belle II, ATLAS, DUNE, PHENIX, preprod testbed) Lustre (sPHENIX, sPHENIX NEW, Three NSLS2 systems, CFN, CSI BNLBOX, STAR/EIC, ATLAS HPC, CSI SciSever) Current Activities: ATLAS dCache storage pool retirement/replacement SciServer Lustre sPHENIX Lustre expansion (~22PB) Development of Generic Lustre Puppet Modules (including monitoring software) for RHEL8 BNL Directorates NSLS2 National Synchrotron Light Source CFN Center for Functional Nanomaterials CSI Computational Science Initiative EIC Electron-Ion Collider 4
