NCI Data Collections BARPA & BARRA2 Overview

NCI Data Collections BARPA & BARRA2 serve as critical enablers of big data science and analytics in Australia, offering a vast research collection of climate, weather, earth systems, environmental, satellite, and geophysics data. These collections include around 8PB of regional climate simulations and are the first two CMIP6-era regional climate downscaling data sets released at NCI. Hosted at NCI, these services provide high-performance data storage co-located with high-performance computing facilities, specialized environments for data analysis, and access to various data services. Users can browse, search, and access datasets through the NCI Data Catalogue, which offers detailed metadata, persistent URLs, and information on data licensing and terms of use. Explore the rich repository of BARPA & BARRA2 data for a deeper understanding of Australia's climate and environmental systems.

• Data Collections
• Climate Science
• Data Analytics
• NCI Services
• Environmental Data

karol Follow

Uploaded on Apr 19, 2024 | 8 Views

Download Presentation

Please find below an Image/Link to download the presentation.

The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author. Download presentation by click this link. If you encounter any issues during the download, it is possible that the publisher has removed the file from their server.

Presentation Transcript

1. NCI Data Collections BARPA & BARRA2 Supporting data curation and publishing AMOS 2024 Yiling Liu Monday 5thFebruary, 2024

2. NCI Data Collections BARPA & BARRA2 A critical enabler of big data science and analytics Australia s largest research collection of climate, weather, earth systems, environmental, satellite, and geophysics data. Around 8PB of regional climate simulations in preparation, and growing BARRA2/BARPA are the first two CMIP6- era regional climate downscaling data collections released at NCI. nci.org.au 2

3. BARPA & BARRA2 Hosted at NCI Data services relevant to BARPA/BARRA2: High Performance Data Storage co-located with High-Performance Computing Australian Research Environment (ARE) and its apps, and our Specialised Environments such as Data Analysis THREDDS Data Service ESGF Australia Node Discovery portal - NCI Data Catalogue More info: NCI Data Services User Guide nci.org.au 3

4. Accessing BARPA & BARRA2 nci.org.au 4

5. NCI Data Catalogue https://geonetwork.nci.org.au/ More info: Data Catalogue User Guide nci.org.au 5

6. Browsing and Searching Datasets Browse Search

7. Example: Browsing the BARPA Data Collection

8. Record Metadata Title Abstract

9. Data registration link Data location at NCI Link to remote data access (if available) Related sites and documentation Linked parent-child records

10. Persistent URL to the record Data licensing & terms of use

11. Information about owner(s), author(s), funder(s) etc.

12. Data Citation nci.org.au 12

13. Data Citation DOIs listed in the NCI Data Catalogue (for each collection as well the individual datasets) BARRA2: https://doi.org/10.25914/1x6g-2v48 BARPA: https://doi.org/10.25914/z1x6-dq28 More info: Data Catalogue User Guide nci.org.au 13

14. Data Citation (continued) Check the README for detailed citation guidance Reference the specific dataset/version, as appropriate More info: BARRA2 Readme & BARPA Readme nci.org.au 14

15. Structure of the Datasets and CORDEX DRS nci.org.au 15

16. BARPA & BARRA2 products and data location -- BARPA |-- output | |-- CMIP6 | | |-- DD |-- AUS-15 # BARPA-R Product | | | |-- AUS-04 # BARPA-C Product | |-- CORDEX # BARPA-R post-processed for CORDEX submission |-- CMIP6 |-- DD |-- AUS-20i More info: BARRA2 Readme & BARPA Readme nci.org.au 16

17. BARPA & BARRA2 products and data location -- BARPA |-- output -- BARRA2 |-- output | |-- CMIP6 |-- Reanalysis | | |-- DD |-- AUS-11 # BARRA-R2 |-- AUS-15 Product | | | |-- AUS-04 | # BARRA-RE2 |-- AUS-22 | Product |-- CORDEX | |-- CMIP6 |-- AUS-04 # BARRA-C2 |-- DD Product |-- AUS-20i * In preparation (see CORDEX-CMIP6 datasets for status updates) More info: BARRA2 Readme & BARPA Readme nci.org.au 17

18. Alignment with CORDEX-CMIP6 data standards where possible -- BARPA |-- output |-- CMIP6 -- <nature of data> or <project_id> for CORDEX -- <MIP-era> |-- DD -- <activity_id> dynamical downscaling(DD) |-- AUS-15 -- <domain_id> |-- BOM -- <RCM-institution_id> |-- ACCESS-ESM1-5 |-- historical -- <driving_source_id> -- <driving_experiment_id> |-- r6i1p1f1 -- <driving_variant_label> |-- BARPA-R -- <source_id> |-- v1-r1 -- <version_realisation> |-- 1hr |-- clt -- <freq> -- <variable_id> |-- v20231101 -- <version> |-- <netcdf filename> More info: BARRA2 Readme & BARPA Readme nci.org.au 18

19. DRS for CORDEX-CMIP6 vs CORDEX-CMIP5 Example of CORDEX-CMIP5: CORDEX/output/AUS-44/UNSW/CSIRO-BOM-ACCESS1-3/rcp45/r1i1p1/UNSW- WRF360J/v1/1hr/tas/v20210629/tas_AUS-44_CSIRO-BOM-ACCESS1-3_rcp45_r1i1p1_UNSW- WRF360J_v1_1hr_2100010100-2100123123.nc Example of CORDEX-CMIP6: CORDEX/CMIP6/DD/AUS-20i/BOM/ACCESS-ESM1-5/historical/r6i1p1f1/BARPA-R-??/v1- r1/1hr/clt/v20231101/tclt_AUS-20i_ACCESS-ESM1-5_historical _r6i1p1f1_BOM_BARPA-R-??_v1- r1_1hr_200801-200812.nc New features in CORDEX-CMIP6: nudging must use the SN suffix in source_id (e.g. RCM123-SN, RCM123A-SN, RCM123T-SN); Reference: CORDEX-cmip5 Archive SpecificationsCORDEX-CMIP6 Archiving Specifications (Second Order Draft) Activity_id: dynamical downscaling (DD); <institution_id>_<source_id> as two DRS elements rather than <institution_id>-<source_id>; <driving_institution_id> is not a part of DRS; Text suffix of Source_id reflects different configurations of the same RCM; RCM simulations with spectral version_realisation: realisations reflect different initial conditions for RCMs (e.g. v1-r1). nci.org.au 19

20. What next? nci.org.au 20

21. Other CORDEX and Downscaled Data Climate & Weather Latest releases: CSIRO CCAM Regional Climate Model data UQ-DES CORDEX datasets In press: NSW NarClim2.0 Data availability for CORDEX and downscaled data: https://opus.nci.org.au/x/2gK9D nci.org.au 21

22. NCI Contacts Address NCI, ANU Building 143 143 Ward Road The Australian National University Canberra ACT 2601 NCI Contacts General enquiries:: help@nci.org.au nci.org.au 22