Snow Cover Validation Workshop 2013 Overview
Fractional Snow Cover –
2013 AWG Validation
Workshop
o
Thomas Painter, Kelley Eicher, Ben Oatley (UCAR)
o
Andy Rost (NOAA)
Outline
o
2012/2013 Validation
o
Validation Tool Status
o
2012/2013 Product Examples
o
Algorithm Enhancements
o
Post-Launch Activities
o
Summary
2012/2013 Validation
o
Processing/Validation period – 11/1/12 through 5/31/13
o
1071 total granules
o
Proxy ABI – MODIS (GOES-R pre-launch validation) *
* data and plots on next slide
Proxy ABI consists of 5 MODIS bands
that approximately coincide with
GOES-R ABI bands.
Snow reflectance – dark blue line
Veg. reflectance – dark red line
2012/2013 Validation (cont.)
Granule 2013112.1550 : 42.5% pixels have snow, 56.5% cloud
Accuracy: 6.67% Precision: 14.49% Omission: 0.1% Co: 0.04%
2012/2013 Validation (cont.)
Granule 2013112.1910 : 36.9% pixels have snow, 33.1% cloud
Accuracy: 2.98% Precision: 11.21% Omission: 2.1% Co: 0.2%
2012/2013 Validation
o
MODIS - TM (GOES-R pre-launch validation)
FSC High-resolution validation
for small areas of select MODIS
granules
2012/2013 Validation (cont.)
o
2012/2013 Validation Summary:
* K. Rittger, et al. 2012
Validation Tool Status
o
Routine Validation Tools
o
basic product comparison stat. generators and
associated data plots (ex. on prev. slides)
o
image generators (ex. on Prod Ex. slides)
o
fully developed
o
Deep Validation Tools
o
High-RMSE Cluster Finder (ex. on next slide)
o
Raw/Verbose Diagnostic mode*
o
Single-Pixel Diagnostic mode*
o
fully developed
* integrated into algorithm code (more info. later)
Validation Tool Status (cont.)
o
High-RMSE Cluster Finder
o
identifies clusters based on input thresholds
o
identifies center pixel of highest average RMSE within
cluster (green)
o
identifies pixel with highest RMSE in cluster (red)
2012/2013 Product Examples
o
Proxy ABI FSC mosaic image for April 22, 2013
2012/2013 Product Ex. (cont.)
o
MODIS FSC mosaic image for April 22, 2013
2012/2013 Product Ex. (cont.)
o
Proxy ABI FSC, Canada/NW US, Apr-May
Day 112, Apr 22
Day 125, May 5
Day 130, May 10
* color key same as mosaics
on previous slides
* true color visual, day 125
Algorithm Enhancements
o
Algorithm “normal” run-mode
o
Bug – modeled fractions <0 not being output
o
fixed
o
revealed extreme fractional values (<<0 and >>1)
o
low-light conditions (often cloud shadow)
o
MODIS band 5 detector issues
o
Shade Filter
o
pixels modeled with shade EM fract > input threshold, set
to NDV and set quality flag (plot on next slide)
o
eliminates extreme values
o
Physical fractions
o
normal output must fall between 0% and 100%
o
over reflectance cases… fraction >1, set to 1
Algorithm Enhancements (cont.)
o
Shade Filter threshold determination
o
21 random granules analyzed (>20% pixels w/ snow)
o
Chose 75%, conservative… <3% of pixels affected
Algorithm Enhancements (cont.)
o
Diagnostic run-mode
o
raw fractional output – no shade filtering, no physical fraction
requirement
o
verbose information output for intermediate state data for
best model. CSV format
o
fully developed
o
Single-pixel Diagnostic run-mode
o
select specific pixel to model
o
verbose information output for intermediate state data for ALL
models considered. CSV format
o
fully developed
o
Parallax Correction (supplemental software, not implemented
in algorithm)
o
adjusts position of data by parallax effect
o
high-res DEM data needed for best correction
o
in testing phase
Post-Launch Activities
o
Surface Reflectance product required
o
not currently planned
o
Continue validation with MODIS data
o
Work towards using newer satellites for validation
o
JPSS
o
NPP VIIRS
o
Landsat 8
o
Validate using NRCS SNOTEL sites
Summary
o
Continued validation efforts show FSC algorithm
performing well
o
Will push algorithm enhancements when AWG is
ready
o
Harris currently evaluating AER implementation
o
Post-Launch operation will require a Surface
Reflectance product
Snow Cover Validation Workshop in 2013 focused on validating fractional snow cover data from November 1, 2012, to May 31, 2013. The workshop highlighted validation processes, tool statuses, product examples, algorithm enhancements, and post-launch activities. Key findings from granules demonstrated percentages of snow and cloud coverage, along with accuracy and precision metrics. The workshop also discussed the validation of high-resolution data for small areas and outlined the summary of validation accuracy and precision percentages. Additionally, it presented details on routine and deep validation tools, including the High-RMSE Cluster Finder.
Download Presentation
Please find below an Image/Link to download the presentation.
The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author.If you encounter any issues during the download, it is possible that the publisher has removed the file from their server.
You are allowed to download the files provided on this website for personal or commercial use, subject to the condition that they are used lawfully. All files are the property of their respective owners.
The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author.
E N D
Presentation Transcript
Fractional Snow Cover 2013 AWG Validation Workshop o Thomas Painter, Kelley Eicher, Ben Oatley (UCAR) o Andy Rost (NOAA)
Outline o 2012/2013 Validation o Validation Tool Status o 2012/2013 Product Examples o Algorithm Enhancements o Post-Launch Activities o Summary
2012/2013 Validation o Processing/Validation period 11/1/12 through 5/31/13 o 1071 total granules o Proxy ABI MODIS (GOES-R pre-launch validation) * Proxy ABI consists of 5 MODIS bands that approximately coincide with GOES-R ABI bands. Snow reflectance dark blue line Veg. reflectance dark red line * data and plots on next slide
2012/2013 Validation (cont.) Granule 2013112.1550 : 42.5% pixels have snow, 56.5% cloud Accuracy: 6.67% Precision: 14.49% Omission: 0.1% Co: 0.04%
2012/2013 Validation (cont.) Granule 2013112.1910 : 36.9% pixels have snow, 33.1% cloud Accuracy: 2.98% Precision: 11.21% Omission: 2.1% Co: 0.2%
2012/2013 Validation o MODIS - TM (GOES-R pre-launch validation) FSC High-resolution validation for small areas of select MODIS granules
2012/2013 Validation (cont.) o 2012/2013 Validation Summary: FSC Validation Accuracy %f Precision %f TM - Obs. 3.0 6.0 MODIS TM * -5.7 8.9 Proxy ABI - MODIS 0.9 6.9 Overall -1.8 (spec. <15%) 12.7 (spec. <30%) * K. Rittger, et al. 2012
Validation Tool Status o Routine Validation Tools o basic product comparison stat. generators and associated data plots (ex. on prev. slides) o image generators (ex. on Prod Ex. slides) o fully developed o Deep Validation Tools o High-RMSE Cluster Finder (ex. on next slide) o Raw/Verbose Diagnostic mode* o Single-Pixel Diagnostic mode* o fully developed * integrated into algorithm code (more info. later)
Validation Tool Status (cont.) o High-RMSE Cluster Finder o identifies clusters based on input thresholds o identifies center pixel of highest average RMSE within cluster (green) o identifies pixel with highest RMSE in cluster (red)
2012/2013 Product Examples o Proxy ABI FSC mosaic image for April 22, 2013
2012/2013 Product Ex. (cont.) o MODIS FSC mosaic image for April 22, 2013
2012/2013 Product Ex. (cont.) o Proxy ABI FSC, Canada/NW US, Apr-May Day 112, Apr 22 Day 125, May 5 Day 130, May 10 * color key same as mosaics on previous slides * true color visual, day 125
Algorithm Enhancements o Algorithm normal run-mode o Bug modeled fractions <0 not being output o fixed o revealed extreme fractional values (<<0 and >>1) o low-light conditions (often cloud shadow) o MODIS band 5 detector issues o Shade Filter o pixels modeled with shade EM fract > input threshold, set to NDV and set quality flag (plot on next slide) o eliminates extreme values o Physical fractions o normal output must fall between 0% and 100% o over reflectance cases fraction >1, set to 1
Algorithm Enhancements (cont.) o Shade Filter threshold determination o 21 random granules analyzed (>20% pixels w/ snow) o Chose 75%, conservative <3% of pixels affected
Algorithm Enhancements (cont.) o Diagnostic run-mode o raw fractional output no shade filtering, no physical fraction requirement o verbose information output for intermediate state data for best model. CSV format o fully developed o Single-pixel Diagnostic run-mode o select specific pixel to model o verbose information output for intermediate state data for ALL models considered. CSV format o fully developed o Parallax Correction (supplemental software, not implemented in algorithm) o adjusts position of data by parallax effect o high-res DEM data needed for best correction o in testing phase
Post-Launch Activities o Surface Reflectance product required o not currently planned o Continue validation with MODIS data o Work towards using newer satellites for validation o JPSS o NPP VIIRS o Landsat 8 o Validate using NRCS SNOTEL sites
Summary o Continued validation efforts show FSC algorithm performing well o Will push algorithm enhancements when AWG is ready o Harris currently evaluating AER implementation o Post-Launch operation will require a Surface Reflectance product
