HNSciCloud and VMDIRAC Project Overview

HNSciCloud and VMDIRAC
Luisa Arrabito
Johan Bregeon
DIRAC@IN2P3 Call 09/03/2017
HNSciCloud Highlights
HNSciCloud Objective
Create a common hybrid science cloud platform for
the European research community
Main Challenges
Compute & Storage
CPU process with intensive data access
Efficient large-scale data management
Transparent data access
Network Connectivity and Federated Identity
Tenders needs to be connected to GEANT
Single Sign-on and authentication services to end-users
supporting eduGAIN
Service Payment Models
Determine the most appropriate purchasing option for
the scientific application workload
Current activities
Solution prototyping
From Oct 18
th
 to Jan 17
th
Objective: to assess the designs produced by the
selected contractors according to the project needs
Pilot deployment
From Jan 17
th
 to March 20
th
3 designs selected
Objective: the contractors build their prototypes and
make them accessible to the buyers group (CERN, CC-
IN2P3, PIC, CNAF
)
Current activities
Prototype Phase
From April to June 2017
3 companies will deploy their proposed solutions
for the hybrid Cloud
Test phase
From June to December 2017
CTA is one of the Use Cases
Work with PIC (ranked 1)
Selected companies: T
s
ystems, RHEA, IBM
CTA Use case
Use VMDIRAC to access hybrid cloud
resources
The output should be useful to other users
communities
Work also to integrate the Data Management
part in DIRAC (e.g. OneData)
Testing VMDIRAC
Tests with 1 cloud provider until now
(T
s
ystems, based on OpenStack)
VMDIRAC debugging needed to take into
account OpenStack evolutions (e.g. new
connection parameters)
Found 2 bugs also in python libcloud
Access to the endpoint
Retrieve floating ips
Testing VMDIRAC
Run the contextualization script manually for
debugging
Minor modifications needed to make it
running (e.g. mounting ephemeral disk, cvmfs
installation)
Job agent correctly running and matching jobs
Next (near future) steps
Check that the VM contextualization works
well also when launched by the CloudDirector
Write documentation for VMDIRAC
installation, configuration and usage
All this will be useful also to access FG Cloud
resources (I’m already testing LUPM-Cloud in
parallel)
Slide Note
Embed
Share

The HNSciCloud and VMDIRAC project aims to create a common hybrid science cloud platform for the European research community, addressing challenges in compute, storage, data management, network connectivity, and identity services. Current activities involve solution prototyping, pilot deployments, and prototype phases with selected companies deploying cloud solutions. The project also focuses on integrating VMDIRAC for accessing hybrid cloud resources and testing with cloud providers like Tsystems based on OpenStack. Various phases and objectives are outlined for the project's progression.

  • HNSciCloud
  • VMDIRAC
  • Hybrid cloud
  • European research
  • Cloud platform

Uploaded on Sep 29, 2024 | 0 Views


Download Presentation

Please find below an Image/Link to download the presentation.

The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author. Download presentation by click this link. If you encounter any issues during the download, it is possible that the publisher has removed the file from their server.

E N D

Presentation Transcript


  1. HNSciCloud and VMDIRAC Luisa Arrabito Johan Bregeon DIRAC@IN2P3 Call 09/03/2017

  2. HNSciCloud Highlights HNSciCloud Objective Create a common hybrid science cloud platform for the European research community

  3. Main Challenges Compute & Storage CPU process with intensive data access Efficient large-scale data management Transparent data access Network Connectivity and Federated Identity Tenders needs to be connected to GEANT Single Sign-on and authentication services to end-users supporting eduGAIN Service Payment Models Determine the most appropriate purchasing option for the scientific application workload

  4. Current activities Solution prototyping From Oct 18thto Jan 17th Objective: to assess the designs produced by the selected contractors according to the project needs Pilot deployment From Jan 17thto March 20th 3 designs selected Objective: the contractors build their prototypes and make them accessible to the buyers group (CERN, CC- IN2P3, PIC, CNAF )

  5. Current activities Prototype Phase From April to June 2017 3 companies will deploy their proposed solutions for the hybrid Cloud Test phase From June to December 2017 CTA is one of the Use Cases Work with PIC (ranked 1) Selected companies: Tsystems, RHEA, IBM

  6. CTA Use case Use VMDIRAC to access hybrid cloud resources The output should be useful to other users communities Work also to integrate the Data Management part in DIRAC (e.g. OneData)

  7. Testing VMDIRAC Tests with 1 cloud provider until now (Tsystems, based on OpenStack) VMDIRAC debugging needed to take into account OpenStack evolutions (e.g. new connection parameters) Found 2 bugs also in python libcloud Access to the endpoint Retrieve floating ips

  8. Testing VMDIRAC Run the contextualization script manually for debugging Minor modifications needed to make it running (e.g. mounting ephemeral disk, cvmfs installation) Job agent correctly running and matching jobs

  9. Next (near future) steps Check that the VM contextualization works well also when launched by the CloudDirector Write documentation for VMDIRAC installation, configuration and usage All this will be useful also to access FG Cloud resources (I m already testing LUPM-Cloud in parallel)

More Related Content

giItT1WQy@!-/#giItT1WQy@!-/#