SMOS Pilot Mission Exploitation Platform (Pi-MEP) Overview

Slide Note

The presentation highlights the tools and capabilities of the SMOS Pilot-Mission Exploitation Platform (Pi-MEP) for providing instantaneous answers to data-related questions, showcasing three ICT infrastructures, and outlining FELYX/NAIAD, Datavore, Datalaps, Merginator, Syntool, and Jupyter notebooks. It also introduces Felyx, an open-source solution for data processing and analysis, along with user cases involving SMOS storms, Sentinel-3 MDB colocation, and S3VT event data processing. The presentation showcases the collaboration between different organizations and the adaptation of tools for the Pi-MEP project.

locastro_z Follow

Uploaded on Sep 12, 2024 | 0 Views

Download Presentation

Please find below an Image/Link to download the presentation.

The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author. Download presentation by click this link. If you encounter any issues during the download, it is possible that the publisher has removed the file from their server.

E N D

Presentation Transcript

SMOS Pilot-Mission Exploitation Platform (Pi-MEP) Presentation of the Pi-MEP tools S bastien Guimbard1, Nicolas Reul2, Jean-Francois Pioll 2, Fr d ric Paul2, Sylvain Herl dan1,Ziad El Khoury Hanna1, Roberto Sabia3 1. Ocean Data Lab, Plouzane, France 2. Ifremer, Laboratoire d oc anographie physique et spatiale, Plouzane, France 3. Telespazio-Vega UK Ltd for ESA, ESRIN, Frascati, Italy SAG meeting, ESTEC, 3 May 2017

How to provide instantaneous answers to simple questions like: Which data are available on this area ? Which data are co-located at this specific period ? Can I see these data and their co-located ones ? 3 ICT infrastructures : Nephelae / Pebsco / Datarmor

Outline FELYX/NAIAD Datavore/Datalaps/Merginator Syntool web Jupyter notebooks

http://felyx.org Felyx provides a free and open source solution to the community for common applications such : Comparison of various processing algorithms (L1, L2) Inter-comparison of various datasets performances Detection and analysis of processing issues Time series analysis Allows to create match-up databases with in situ data, time series at specific locations or data extraction over hurricanes Written in python, using Ifremer cerbere library for data reading interface with any format Adaptation effort for PI-MEP mostly consists in writing missing cerbere data readers and ingestion of the in situ data into felyx

User case 1 : SMOS Storm

User case 1 : SMOS Storm

S3VT 15-17 Feb 2017 Felyx use case 2 : Sentinel-3 MDB Colocation window : 2h (12h for Argo), 5km 21 x 21 pixel boxes 6h of in situ data history In situ data : Copernicus/CMEMS (Coriolis) ISAR radiometer on opportunity ships (delayed-mode) Sentinel-3 data : L1 infra-red channels L2 (SST) all fields, incl. meteo and ancillary fields New : calculated SST from scientific prototype Other sensor data Metop-B/AVHRR, MODIS, VIIRS, MSG/SEVIRI Resampling of all data to SLSTR grid Daily aggregated match-up files on FTP : stack all matchups into a single file. Currently two versions : NRT and REP

S3VT 15-17 Feb 2017 In situ sources for reprocessed MDB

S3VT 15-17 Feb 2017

Naiad Naiad is the historical Cersat tool for data search (similar to datahub) and cross-over detection Now completely rewritten as an open source python using same interfaces and dependencies as felyx => writing the cerbere data readers for felyx make automatically the corresponding datasets usable in Naiad Now more oriented as an easy to install/use command line tool Python API for direct usage in scripts, Jupyter notebooks, etc. Used for multi-sensor cross detection at Eumetsat (Sentinel-3 cal/val) => cross-overs between SLSTR, OLCI, Metop AVHRR and IASI, SEVIRI, http://naiad.readthedocs.io/en/latest/

Naiad: Principle Swath (any type of data) are virtually tiled, each tile stored with some metadata (for search) and reference to the source product (ex : here SMAP) The tile metadata are stored in a powerfull indexing engine (ElasticSearch, similar to Solr used in DataHub) Dynamic search is performed through different dataset indexes for cross-over detection, with flexible criteria defined by users

Datavore Quick discovery and preview of Pi-MEP datasets, interactive access to colocated data, precomputed statistics, raw data Datavore engine easily ingested most of Pi-MEP data satellite scenes, orbits, L3/L4 grids model, in-situ profiles, buoys images (eg. quicklooks) misc. (eg. storm/icebergs tracks) Indexing (by tile, at several zoom levels) time and spatial coverage meta-data pre-computed statistics data (resampled or full) Providing API & interactive ways to make request

Datavore Datavore

Datalaps Use datavore framework to explore time series Datalaps

Merginator Explore spatial patterns of numerous datasets at a glance Merginator

Syntool web Quick visualization tool, enabling environmental understanding through easy and convenient display of images. => It achieves a responsive display by having pre-rendered "tiles" of images that are directed to the users display, rather than generating images on the fly. The images are handled using a robust interface based on OpenLayer software. A key component of the display is the user's control over the order and transparency of images, allowing different sensors to be displayed without the base images being totally obscured.