OSCAR 2.0: Serverless Computing for Data-Processing Applications

OSCAR 2.0: Serverless Scientific
Computing
EGI Service Design Workshop
Instituto de Instrumentación para Imagen Molecular
Universitat Politècnica de València, Spain
Sebastián Risco
, Germán Moltó,
Diana María Naranjo, Miguel Caballer
Open Source Serverless Computing for Data-Processing
Applications
Platform to support the Functions as a Service (FaaS)
computing model for containerised file-processing applications
Initial prototype version was co-funded by the 
EGI Strategic
and Innovation Fund
 and reached TRL6
What’s new?
Redesigned architecture to support a new Functions Definition
Language (FDL) in order to easily define serverless workflows
Improved user interface
Integrated with the SCAR tool, enabling the definition of hybrid
workflows, i.e. across the Cloud continuum (OSCAR clusters and
Amazon Web Services)
Introduce the service: OSCAR 2.0
Introduce the service: OSCAR 2.0
Suitable for user communities who want to deploy
data-driven containerised applications across
serverless platforms (with automated elasticity)
Upload file -> Retrieve processed file
Developed by the UPV-GRYCAP (authors of the
Infrastructure Manager (IM) and Elastic Cloud
Computing Cluster (EC3) services already integrated
with EGI
Publicly available at:
https://github.com/grycap/oscar
 
https://github.com/grycap/scar
OSCAR is already integrated with:
The EGI Applications on Demand portal through the EC3 portal, and integrated
with the IM Dashboard
The EGI DataHub (Onedata) 
o
as the output storage back-end to store the results of the computations
o
there is a connector to periodically poll for changes in a Onedata space to trigger the
functions (suboptimal)
OSCAR would like to have the following support from these EGI services:
Onedata should allow to define webhooks to be able to trigger the execution of
the functions without doing an active polling
EGI integration plans
for OSCAR 2.0
EGI integration plans
for OSCAR 2.0
SDTP section: Service Transition Plan
for OSCAR 2.0
Transition plan
We plan to create a specific portal for OSCAR, integrated with EGI Check-In, to
deploy OSCAR clusters and to manage the lifecycle of functions (outside the EC3
portal for enhanced visibility)
Increase the Technology Readiness Level (TRL6 -> TRL8)
Supporting projects
BigCLOE (Spanish National R+D project, ending in 2020)
AI_SPRINT - Artificial Intelligence in Secure Privacy-preserving Computing
Continuum (Horizon 2020, starting in 2021)
Open issues
for OSCAR 2.0
Some sites have the MinIO access port blocked
It would be convenient to unify the firewall management of the different
endpoints that conform FedCloud (or at least know the open port ranges)
Better integration with EGI DataHub
Webhooks support
On-boarding of new use cases
Face mask detection on public crowds using AI and serverless platforms across the
Cloud continuum with OSCAR
Anything you can suggest
We are open to new proposals and use cases
Sebas Risco - serisgal@i3m.upv.es 
Germán Moltó  - gmolto@dsic.upv.es
Thank you!
 
 
Slide Note
Embed
Share

OSCAR 2.0 is an open-source platform that supports the Functions as a Service (FaaS) computing model for containerized file-processing applications. Its redesigned architecture now includes a new Functions Definition Language (FDL) for defining serverless workflows easily. The platform offers improved user interface and integration with the SCAR tool to enable the creation of hybrid workflows across various cloud services. Developed by UPV-GRYCAP, OSCAR 2.0 is suitable for user communities deploying data-driven containerized applications on serverless platforms.


Uploaded on Dec 10, 2024 | 0 Views


Download Presentation

Please find below an Image/Link to download the presentation.

The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author. Download presentation by click this link. If you encounter any issues during the download, it is possible that the publisher has removed the file from their server.

E N D

Presentation Transcript


  1. EGI: Advanced Computing for Research www.egi.eu @EGI_eInfra EGI Service Design Workshop OSCAR 2.0: Serverless Scientific Computing Sebasti n Risco, Germ n Molt , Diana Mar a Naranjo, Miguel Caballer Instituto de Instrumentaci n para Imagen Molecular Universitat Polit cnica de Val ncia, Spain The work of the EGI Foundation is partly funded by the European Commission under H2020 Framework Programme

  2. Introduce the service: OSCAR 2.0 Open Source Serverless Computing for Data-Processing Applications Platform to support the Functions as a Service (FaaS) computing model for containerised file-processing applications Initial prototype version was co-funded by the EGI Strategic and Innovation Fund and reached TRL6 What s new? Redesigned architecture to support a new Functions Definition Language (FDL) in order to easily define serverless workflows Improved user interface Integrated with the SCAR tool, enabling the definition of hybrid workflows, i.e. across the Cloud continuum (OSCAR clusters and Amazon Web Services) www.egi.eu @EGI_eInfra 2 11/04/20

  3. Introduce the service: OSCAR 2.0 Suitable for user communities who want to deploy data-driven containerised applications across serverless platforms (with automated elasticity) Upload file -> Retrieve processed file Developed by the UPV-GRYCAP (authors of the Infrastructure Manager (IM) and Elastic Cloud Computing Cluster (EC3) services already integrated with EGI Publicly available at: https://github.com/grycap/oscar https://github.com/grycap/scar www.egi.eu @EGI_eInfra 3 11/04/20

  4. EGI integration plans for OSCAR 2.0 OSCAR is already integrated with: The EGI Applications on Demand portal through the EC3 portal, and integrated with the IM Dashboard The EGI DataHub (Onedata) o o as the output storage back-end to store the results of the computations there is a connector to periodically poll for changes in a Onedata space to trigger the functions (suboptimal) OSCAR would like to have the following support from these EGI services: Onedata should allow to define webhooks to be able to trigger the execution of the functions without doing an active polling www.egi.eu @EGI_eInfra 4 11/04/20

  5. EGI integration plans for OSCAR 2.0 www.egi.eu @EGI_eInfra 5 11/04/20

  6. SDTP section: Service Transition Plan for OSCAR 2.0 Transition plan We plan to create a specific portal for OSCAR, integrated with EGI Check-In, to deploy OSCAR clusters and to manage the lifecycle of functions (outside the EC3 portal for enhanced visibility) Increase the Technology Readiness Level (TRL6 -> TRL8) Supporting projects BigCLOE (Spanish National R+D project, ending in 2020) AI_SPRINT - Artificial Intelligence in Secure Privacy-preserving Computing Continuum (Horizon 2020, starting in 2021) www.egi.eu @EGI_eInfra 6 11/04/20

  7. Open issues for OSCAR 2.0 Some sites have the MinIO access port blocked It would be convenient to unify the firewall management of the different endpoints that conform FedCloud (or at least know the open port ranges) Better integration with EGI DataHub Webhooks support On-boarding of new use cases Face mask detection on public crowds using AI and serverless platforms across the Cloud continuum with OSCAR Anything you can suggest We are open to new proposals and use cases www.egi.eu @EGI_eInfra 7 11/04/20

  8. EGI: Advanced Computing for Research www.egi.eu @EGI_eInfra Thank you! Sebas Risco - serisgal@i3m.upv.es Germ n Molt - gmolto@dsic.upv.es The work of the EGI Foundation is partly funded by the European Commission under H2020 Framework Programme

More Related Content

giItT1WQy@!-/#giItT1WQy@!-/#giItT1WQy@!-/#giItT1WQy@!-/#giItT1WQy@!-/#