HPC Strategy and Initiatives at MINES.EDU
Explore the current state, initiatives, and business plan development of High-Performance Computing (HPC) at MINES.EDU. Discover insights on HPC clusters, cloud approaches, and sub-committee members involved in shaping the future of HPC strategy.
Download Presentation
Please find below an Image/Link to download the presentation.
The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author. If you encounter any issues during the download, it is possible that the publisher has removed the file from their server.
You are allowed to download the files provided on this website for personal or commercial use, subject to the condition that they are used lawfully. All files are the property of their respective owners.
The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author.
E N D
Presentation Transcript
HPC Strategy February 2, 2023 MINES.EDU
Agenda Current state of HPC Current HPC initiatives HPC Business Model (CapEx to OpEx) HPC Business Model Deployment Project Timelines MINES.EDU
Current State of HPC @ Mines Currently 2 clusters at Mines @ ~85% efficiency Wendian (2019); 90 nodes (~25M core-hr) End of Support Aug. 23 Mio (2014-2018); 139 nodes (~30M core-hr) Currently end of life * *Added GPU Resources MINES.EDU
Current Initiatives Cloud approaches Cloud native submissions - Workflows designed in the cloud (AWS, Google, Azure) Hybrid submissions Users have their choice to submit jobs to a selection of resources (on-prem, private cloud, public cloud) Managed services Managed HPC at other university or organization Managed HPC at another commercial provider MINES.EDU
Current Initiatives Three efforts in progress: Native HPC cloud deployment Cloud submissions from on-premise scheduler Co-location of additional HPC resources Pilot in- progress Pilot in- progress on-prem solution Draft MOU Aug. 23 MINES.EDU
HPC Business Plan Development Original re-charge model developed in 2018 for Wendian proved flawed: It is not "Consistent-Reasonable-Allocable Faculty Council sub-committee organized to recommend model that meets: Federal funding requirements (2 CFR 200 s) HPC requirements for the majority of Mines use-cases Two major cultural shifts in mines HPC Capital purchase to a pay-for-use model (core-hr). Lack of priority access MINES.EDU
HPC Sub-committee Members Member Affiliation Title Jeff Shragge (Chair) GP Associate Professor Mahadevan Ganesh AMS Professor Zhexuan Gong PH Assistant Professor Mehmet Belviranli CS Assistant Professor Mark Deinert ME Associate Professor Vladan Stevanovic MME Associate Professor Yvette Kuiper GGE Associate Professor Johanna Eagan ORA Director of Research Administration Noelle Sanchez Admin & Operations Controller Matt Ketterling ITS Sr Director of Infrastructure & RC Solutions Torey Battelle ITS/HPC Assistant Director of Research Computing MINES.EDU
HPC Business Plan - Cost Model Provider Core-hr Rate Storage Rate Mines On-prem $0.02* $60 per TB, annually other partner Unknown at this time Unknown at this time Public Cloud (AWS)** $0.04 - $0.10 $144 - $288 per TB, annually *HPC teaching activities to be covered by ITS budget (not departments) **Does not include costs of data movement significant cost MINES.EDU
HPC Example Wendian Costs Group Example Group Usage* Usage (% of cluster) Cost per annum (CPU-hours / year) CH 2 760,397 4.0% $15.2k ME 2 519,194 2.7% $10.4k PH 1 295,872 1.6% $5.9k ME 1 37,098 0.2% $1.4k CH 1 10,836 0.05% $0.7k *Annual averages based on group usage between 03/19 and 12/21 MINES.EDU
HPC Example Wendian Costs Department* Example Group Usage** Usage (% of cluster) Cost per annum (CPU-hours / year) MME 5,952,789 33.2 $119.1k Chemistry 5,114,961 28.5 $102.3k Chem & Bio Eng 3,141,815 17.5 $62.8k MechEng 1,236,511 6.9 $24.7k GP 877,002 4.9 $17.5k AMS 454,890 2.5 $9.1k Physics 316,587 1.8 $6.3k ChemEng 255,977 1.4 $5.1k *Cost per annum of departments not listed are <$3k **Annual averages based on departmental usage between 03/19 and 12/21 MINES.EDU
