EOSDIS FY2010 Annual Metrics Report
The EOSDIS FY2010 Annual Metrics Report provides an overview of data metrics and web activities at the Earth Observation System Data and Information System (EOSDIS) data centers during Fiscal Year 2010. The report includes statistics on data ingest, archive, distribution, and web metrics collected by the Earth Science Data and Information System (ESDIS) Metrics System. It presents comparisons with previous years and introduces new metrics for Near-Real Time (NRT) and CALIPSO products. The report aims to offer insights into EOSDIS performance and trends for the specified period.
Download Presentation
Please find below an Image/Link to download the presentation.
The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author. Download presentation by click this link. If you encounter any issues during the download, it is possible that the publisher has removed the file from their server.
E N D
Presentation Transcript
EOSDIS FY2010 Annual Metrics Report Prepared By: Hyo Duck Chang Adnet, Inc. Brian Krupp Adnet, Inc. Lalit Wanchoo Adnet, Inc. February 2011
Preface The Earth Sciences Data and Information System (ESDIS) Project (Code 423) is pleased to present the following report on metrics from across the Earth Observation System Data and Information System (EOSDIS). The 12 Data Centers of EOSDIS support different scientific disciplines and provide an individualized set of products and services to their science community and the public. Although discipline oriented, the data centers engage in common data management functions of ingest, archive and distribution, as well as describing their data and services on web sites. Metrics are collected on a daily basis from each data center. The ESDIS Project collects these metrics in a tool called the ESDIS Metrics System (EMS). Data center analysts can view their detailed metrics to assess internal performance and trends. The ESDIS project combines these metrics, not for comparisons between the data centers, but as a system level view of EOSDIS performance. This report provides snapshots of metrics as the combination of the individual data centers and from a purely system perspective. During FY2010, EMS received new metrics that were not available in the previous years and they are included in this annual report. The new metrics include ingest and archive metrics from SEDAC and LaRC ANGe, and distribution metrics from NSIDC Search Light (NSIDCSRCHLT). This year's report also includes separate metrics for the Near- Real Time (NRT) and CALIPSO products for the first time. There are some data centers that are in the process of developing their interfaces with the EMS and their testing/reconciliation activities have not yet been completed. Therefore, some data centers do not yet deliver metrics data in all parameter categories these will be added in future reports. In keeping with previous years, and in order to support trend comparisons, the metrics data are presented on a fiscal year basis, not by calendar year. If you have any questions or comments please contact Jeanne Behnke at (301) 614-5326 or jeanne.behnke@nasa.gov or Kevin Murphy at (301) 614-5580 or kevin.j.murphy@nasa.gov. February 2011 FY2010 Annual Report 2
Introduction This report presents statistics on data metrics and web activities at the EOSDIS data centers during Fiscal Year 2010 (October 1, 2009 through September 30, 2010) from the Earth Science Data and Information System (ESDIS) Metrics System (EMS). EMS supports the ESDIS project management by collecting and organizing various metrics from the Earth Observing System (EOS) Data and Information System (DIS) Data Centers and other Data Providers. The EMS collects and presents data on the usage of products and services delivered via the Internet or managed in EOSDIS archives. EMS consists of a Data Metrics component and a Web Metrics component. The Data Metrics component provides statistics on data ingest, archive and distribution plus data users profile information collected from Data Providers. The Web Metrics component provides statistics on web site visits, views and visitors with a variety of related parameters. This report contains tables and graphs of FY2010 statistics and comparisons to previous years. Values for previous fiscal years are produced from EMS unless noted otherwise. Summary tables, text, graphs, and more detailed statistics tables are also included. New to this year's report are separate metrics for the Near-Real Time (NRT) and CALIPSO products. It is important to note that metrics for the NRT and CALIPSO products are not used in the distribution trend analyses presented in this report. Also new to this year's report are the statistics for unique data products distributed by EOSDIS data centers during FY2010. Definitions for terms used in this report can be found on the Definitions worksheet. February 2011 FY2010 Annual Report 3
Summary EOSDIS Metrics (Oct. 1, 2009 to Sept. 30, 2010) Unique Data Sets Distinct Users of EOSDIS Data and Services Web Site Visits Average Archive Growth Total Archive Volume End User Distribution Products End User Average Distribution Volume > 4,200 > 1.1 M > 1.1 M 2.9 TB/day 4.5 PB > 412 M 9.9 TB/day Unique Data Sets: Total number of unique data sets distributed in the fiscal year. Distinct Users of EOSDIS Data and Services: Total unique users across EOSDIS Data Users and Web Visitors, per data center and summed Web Site Visits: Sum of web visits for data centers where a visit represents a user session not broken by more than 30 minutes and a duration of at least one minute Average Archive Growth: Sum across reporting data centers of the data volume added to the individual archives divided by the days in the year Total Archive Volume: Sum across reporting data centers of the data volumes in the archive as of end of the fiscal year End User Distribution Products: Total number of products distributed from all reporting data centers End User Average Distribution Volume: Sum across reporting data centers of the data volume distributed for the fiscal year divided by the days in the year February 2011 FY2010 Annual Report 4
Data Metrics Distribution By Data Center Volume by Domain Products by Domain Near Real-time Products CALIPSO Products Top 20 Countries Top 10 Products Unique Product Count Ingest Archive Total Archive Data Users Distinct Users Repeat Users Top 20 Countries Foreign Distribution February 2011 FY2010 Annual Report 5
Ingest Ingest is the amount of data coming into a data center over a period of time and includes all product levels. For this report, the data is presented as the amount of data entered into each data center during FY2010. The sum of all data centers is the total ingest for EOSDIS. During FY 2010 CDDIS, LARC ANGe and SEDAC started to report their ingest statistics. Data Center Volume (TBs) Files (Millions) ASDC CDDIS GESDISC GHRC LPDAAC MODAPS NSIDC PODAAC SEDAC Total 143.9 0.2 106.9 3.5 70.4 49.6 14.7 0.3 2.3 391.9 5.7 4.4 4.2 0.4 5.5 0.3 2.3 0.1 0.0 22.9 February 2011 FY2010 Annual Report 6
Archive Archive is the amount of data added to the archive over a period of time and includes all products levels. Archive metrics for CDDIS, OBPG and NSIDC V0 are not available at this time. Since LARC ANGe archive data became available from June 2010, the data provided by ASDC (Lindsay Parker in his e-mail of 11/18/2010) were used for October 2009 - May 2010. Data Center Volume (TBs) Files (Millions) ASDC ASF GESDISC GHRC LPDAAC MODAPS NSIDC PODAAC ORNL SEDAC Total 229.7 68.4 97.2 1.5 70.4 563.0 14.7 0.4 3.9 2.7 1,052.0 9.4 0.0 8.0 0.1 5.5 14.9 2.1 0.3 0.3 0.0 40.6 February 2011 FY2010 Annual Report 7
Total Archive Size The Total Archive Size describes the EOSDIS archive at the end of FY2010. This includes all data (including ancillary) but not data marked for deletion. Data Center Volume (TBs) Files (Millions) ASDC ASF GESDISC GHRC LPDAAC MODAPS NSIDC ORNL PODAAC SEDAC Total 2,082.8 448.5 381.5 75.4 0.2 39.0 0.4 43.5 25.2 16.9 0.3 2.4 0.0 203.3 6.8 822.3 768.3 66.1 0.4 32.9 2.7 4,612.3 February 2011 FY2010 Annual Report 8
Distribution By Data Center Distribution presents the amount of data successfully distributed to Public Users. Distribution by Data Center ASF CDDIS GESDISC GHRC ASDC LPDAAC MODAPS NSIDC ORNL PO.DAAC SEDAC OBPG* Total Products (Millions) Volume (TBs) 0.10 52.60 84.22 0.66 4.41 51.95 79.76 22.90 49.88 50.33 3.57 12.43 412.80 2.66 17.43 698.68 12.41 232.71 952.71 1,287.38 140.17 4.99 104.92 1.43 173.85 3,629.34 * OBPG data taken from the Ocean Color Website February 2011 FY2010 Annual Report 9
Volume Distribution By Domain Volume Distribution presents the volume of data successfully distributed to Public Users by Domain. Domain ASF CDDIS GES DISC GHRC ASDC LP DAAC MODAPS NSIDC ORNL PO.DAAC SEDAC OBPG* Total Foreign US COM US EDU US GOV US ORG US Other Unknown Total Volume (TBs) 0.14 0.01 1.07 1.34 0.02 0.08 0.00 11.50 0.61 1.36 3.37 0.05 0.50 0.03 175.25 21.89 268.20 210.06 2.88 14.87 5.53 3.75 0.33 2.92 4.35 0.00 0.54 0.52 68.39 46.68 42.15 55.62 0.30 0.27 19.31 305.83 201.18 104.72 209.24 2.09 16.37 113.29 539.41 33.85 148.63 505.65 0.77 54.53 4.53 44.22 10.34 17.84 24.51 1.35 25.15 16.76 3.01 0.42 1.17 0.15 0.02 0.18 0.06 43.72 4.22 16.59 32.95 0.01 6.11 1.32 0.66 0.21 0.07 0.02 0.01 0.07 0.38 0.00 0.00 0.00 0.00 0.00 0.00 1,195.88 319.75 604.72 1,047.25 7.50 118.65 335.58 173.85 2.66 17.43 698.68 12.41 232.71 952.71 1,287.38 140.17 4.99 104.92 1.43 173.85 3,629.34 * OBPG data taken from the Ocean Color Website February 2011 FY2010 Annual Report 10
Product Distribution By Domain Product Distribution presents the number of products successfully distributed to Public Users by Domain. Domain ASF CDDIS GES DISC GHRC ASDC LP DAAC MODAPS NSIDC ORNL PO.DAAC SEDAC OBPG* Total Foreign US COM US EDU US GOV US ORG US Other Unknown 0.01 0.00 0.04 0.01 0.00 0.04 0.00 36.33 1.97 3.77 9.05 0.30 1.07 0.11 25.29 2.56 36.01 18.58 0.18 1.06 0.55 0.15 0.07 0.24 0.15 0.00 0.04 0.01 1.43 0.74 0.74 0.87 0.02 0.00 0.59 24.04 7.99 4.95 11.33 0.06 0.70 2.89 31.76 2.58 9.34 32.98 0.06 2.56 0.47 6.79 1.15 1.44 1.18 0.32 11.60 0.41 1.60 0.51 47.71 0.04 0.00 0.03 0.00 23.48 3.23 4.46 16.92 0.01 1.85 0.38 1.95 0.96 0.29 0.07 0.04 0.22 0.04 0.00 0.00 0.00 0.00 0.00 0.00 12.43 152.84 21.77 108.98 91.18 1.00 19.18 17.86 Total Products (Millions) 0.10 52.60 84.22 0.66 4.41 51.95 79.76 22.90 49.88 50.33 3.57 12.43 412.80 * OBPG data taken from the Ocean Color Website February 2011 FY2010 Annual Report 11
Distribution of NRT Products Near Real-time (NRT) Distribution provides the amount of data successfully distributed to registered users of the Land Atmosphere Near Real-time Capability for EOS (LANCE). LANCE provides access to near real-time data (<3 hours from observation) from MODIS, AMSR-E, AIRS, and MLS instruments. Distribution metrics are presented in volume, numbers of files distributed and users. Instrument AIRS AMSR-E ** MLS MODIS - Aqua MODIS - Terra OMI NRT Total # of Files * Vol (GB) 14,857.89 # of Users 967,565 9,392 2,216,682 6,272,388 7,798,346 347 15 45 111 157 333.11 403.09 90,569.37 138,933.95 149 4.62 5 17,264,522 245,102.03 680 * Excludes metadata ** Includes the NRT products from GHRC and MODAPS February 2011 FY2010 Annual Report 12
Distribution of CALIPSO Products Although not an EOSDIS supported mission, the Cloud-Aerosol Lidar and Infrared Pathfinder Satellite Observations (CALIPSO) is an Earth science mission with data available through the Atmospheric Sciences Data Center (ASDC) at NASA Langley Research Center. The tables below provide distribution statistics particular to CALIPSO. These statistics are not included in the EOSDIS totals. Mission CALIPSO CALIPSO CALIPSO Instrument # of Files * 5,669,074 140,908 Vol (GB) 548,067.13 3,434.78 1,370.94 552,872.85 # of Users CALIOP Imaging Infrared Radiometer Wide Field Camera Total for CALIPSO 577 58 32 667 22,898 5,832,880 * Excludes metadata February 2011 FY2010 Annual Report 13
Data Distribution - Top 20 Countries Top 20 Countries by Volume Distributed* Top 20 Countries by Products Distributed** Volume (GBs) 2,148,225.78 232,234.02 215,863.71 185,160.33 70,875.69 65,178.53 63,201.71 57,299.42 47,591.64 45,701.68 27,166.91 23,074.19 21,026.96 18,119.00 13,519.92 12,738.83 12,100.23 10,997.59 8,701.05 7,640.16 Country Country Products 242,093,094 27,026,170 21,927,902 12,734,866 10,235,719 8,945,333 8,581,528 6,600,995 5,476,948 4,292,689 4,111,128 4,032,369 3,184,180 3,067,623 2,954,355 2,819,613 2,605,333 2,172,210 2,042,669 1,797,919 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 United States China Japan France Korea, Republic of United Kingdom Germany Belgium Italy Canada Spain Netherlands Australia Brazil Taiwan Denmark South Africa Russian Federation Finland India 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 United States China Japan United Kingdom France Korea, Republic of Germany Denmark Russian Federation Spain Norway Canada Taiwan Finland Italy Brazil India South Africa Netherlands Luxembourg * Some products are inherently larger than other files in size and therefore may skew the results. ** When counting # of files, metadata files are not included. February 2011 FY2010 Annual Report 14
Distribution of Unique Data Products Tables below show the number of unique data products distributed to public users during FY2010. In counting unique products, metadata were excluded. Also excluded are the NRT and CALIPSO products. DAAC ASF CDDIS GES DISC GHRC ASDC LP DAAC MODAPS NSIDC ORNL PO DAAC SEDAC Total # of Products * 36 180 1,246 158 458 306 356 256 923 193 179 4,291 * OBPG is not included since no product information is available. February 2011 FY2010 Annual Report 15
Data Distribution - Top 10 Products Top 10 Products Distributed By Volume* Product Description GBs Files 2,850,783 2,378,453 6,432,178 1,707,672 9,320,890 1,629,756 4,865,754 816,726 1,252,625 675,024 1 2 3 4 5 6 7 8 9 10 MOD09GA MOD021KM MOD03 MYD021KM AIRIBRAD MYD09GA MYD03 MOD13Q1 MOD09GQ MOD02HKM MODIS/Terra Surface Reflectance Daily L2G Global 1km and 500m SIN Grid MODIS/Terra Level 1B Calibrated Radiances - 1km MODIS/Terra Geolocation - 1km MODIS/Aqua Level 1B Calibrated Radiances - 1km AIRS/Aqua infrared geolocated radiances MODIS/Aqua Surface Reflectance Daily L2G Global 1km and 500m SIN Grid MODIS/Aqua Geolocation - 1km MODIS/Terra Vegetation Indices 16-Day L3 Global 250m SIN Grid MODIS/Terra Surface Reflectance Daily L2G Global 250m SIN Grid MODIS/Terra Level 1B Calibrated Radiances - 500m 226,826.39 210,100.01 158,329.60 156,542.44 141,685.42 126,802.22 122,261.48 114,249.90 100,876.07 86,922.21 * Some products are inherently larger than other files in size and therefore may skew the results. Top 10 Products Distributed By Products** Product Description Files** 47,126,600 15,365,035 12,207,462 12,004,610 9,906,940 9,506,179 9,320,890 7,170,225 6,810,203 6,432,178 GBs 2,782.47 5,158.29 14,338.23 15,691.49 11,740.50 9,297.75 141,685.42 8,949.83 4,584.40 158,329.60 1 2 3 4 5 6 7 8 9 10 MOD13Q1 GNSS_DAILY_D MOD04_L2 GHRSST_248 MYD04_L2 GHRSST_250 AIRIBRAD TRMM_3B42 GNSS_DAILY_O MOD03 MODIS/Terra Vegetation Indices 16-Day L3 Global 250m ISIN Grid GNSS Daily Compact Observation Data MODIS/Terra Level 2 Aerosol GHRSST Level 2P USA NASA MODIS Aqua 11 micron SST MODIS/Aqua Level 2 Aerosol GHRSST Level 2P USA NASA MODIS Terra 11 micron SST AIRS/Aqua infrared geolocated radiances TRMM 3B42 3-Hour 0.25deg x 0.25deg and Other-GPI Calibration Rainfall GNSS Daily Observation Data MODIS/Terra Geolocation - 1km ** When counting # of files, metadata files are not included. February 2011 FY2010 Annual Report 16
Distinct Data Users Distinct Data Users presents the number of distinct public users* who received data product files. Domain ASF CDDIS GES DISC GHRC ASDC LP DAAC MODAPS NSIDC ORNL PO.DAAC SEDAC Total Foreign US COM US EDU US GOV US ORG US Other Unknown Total Distinct Data Users 218 91 74 33 31,252 6,820 1,252 2,066 162 1,991 825 27,484 11,936 4,850 2,719 209 2,249 767 1,391 873 228 152 647 477 358 276 12,303 5,956 2,385 800 156 391 185 112,208 3,907 1,872 1,306 3,303 1,239 917 317 9,511 3,727 2,300 484 14,079 3,546 2,139 1,215 122,794 57,258 8,881 1,934 335,190 95,830 25,256 11,302 1,760 17,599 9,851 1 5 9 6 55 649 44 575 129 83 463 239 58 324 430 978 43 8 72 30 10,836 5,301 20 1,917 468 44,368 50,214 2,751 1,793 22,176 121,914 6,524 16,807 21,791 207,982 496,788 * Does not include OBPG users February 2011 FY2010 Annual Report 17
Repeat Data Users Repeat users are distinct Public users* who received data on more than one day in the fiscal year. Domain ASF CDDIS GES DISC GHRC ASDC LP DAAC MODAPS NSIDC ORNL PO.DAAC SEDAC Total Foreign US COM US EDU US GOV US ORG US Other Unknown Total Repeat Data Users 21 21 32 11 1 19 1 9,133 2,776 521 1,019 101 973 160 6,753 2,241 1,681 1,204 226 262 72 60 260 190 152 139 4,763 2,406 997 380 9,975 1,379 688 526 1,022 316 327 144 1,493 970 429 3,367 700 567 423 11,862 4,605 998 608 278 2,154 298 48,875 15,866 6,464 4,611 580 4,364 914 97 18 62 19 57 549 131 0 3 3 68 119 51 18 302 109 25 99 56 11 74 72 10 5 12 106 14,683 12,616 635 759 8,784 12,997 1,989 3,088 5,214 20,803 81,674 * Does not include OBPG users February 2011 FY2010 Annual Report 18
Data Users - Top 20 Countries Ranking 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 Country # of Users United States China United Kingdom India Canada Germany Australia France Brazil Japan Russia Italy Spain Mexico Netherlands Indonesia Korea, South Argentina Chile Peru 145,681 118,822 17,217 15,782 14,538 13,845 10,118 9,680 7,450 6,905 6,638 6,244 5,793 4,886 4,225 3,269 3,260 3,141 2,809 2,631 February 2011 FY2010 Annual Report 19
Foreign Distribution Foreign Country # of Users # of Products (1000s) Vol (TBs) EU * Canada China ** Japan Other 78,499 14,538 118,822 6,905 107,854 58,442 4,032 27,026 21,928 41,414 503.06 44.63 226.79 210.80 210.60 * EU includes 27 European Union member countries. ** China includes only People s Republic of China and does not include Taiwan. February 2011 FY2010 Annual Report 20
Web Metrics Visitors and Visits Repeat Visitors Top 20 Domains Top 20 Countries February 2011 FY2010 Annual Report 21
Web Visitors and Visits EOSIDS web activity is measured by the number of Visits made, the number of pages Viewed and the number of distinct Visitors. Visits, Views, and Visitors count visits greater than or equal to 1 minute. Visits of at least one minute are considered to represent significant work accomplished, and many of the shorter visits are of less than a second. # Unique Visitors Month # Visits # Views Oct-09 Nov-09 Dec-09 Jan-10 Feb-10 Mar-10 Apr-10 May-10 Jun-10 Jul-10 Aug-10 Sep-10 88,935 84,479 76,588 96,273 98,554 111,473 107,216 94,091 87,822 82,925 83,636 96,866 940,100 1,025,728 810,072 1,024,598 1,157,595 1,435,764 1,249,127 1,230,002 1,057,854 1,122,336 1,328,911 1,272,059 64,432 62,023 56,303 70,527 74,159 79,575 76,394 65,456 58,529 55,567 56,625 69,725 FY2010 1,108,858 13,654,146 789,315 February 2011 FY2010 Annual Report 22
Repeat Web Visitors EOSDIS Web Visitors are characterized by the number of visits they make and how frequently they return. Visitors counted in the table below are those that stayed for one minute or more. Repeat Visitors are counted from the start of the Fiscal Year. FY2010 Web Visitors for Visits of one minute or more Total Visitors # of Visits 2 3 4 5-6 7-9 10 - 14 15 - 24 25 - 49 50 - 99 100+ All DAACs 67,021 22,464 10,680 10,173 6,128 3,836 2,233 1,213 354 100 124,202 February 2011 FY2010 Annual Report 23
Top 20 Domains By # of Web Visitors The FY2010 Top 20 Domains for visits >= 1 minute is sorted by the # of Visitors. Domains are as defined by NetInsight. Percent Visitors 7.70% 6.30% 2.90% 1.30% 0.60% 0.50% 0.50% 0.30% 0.30% 0.30% 0.30% 0.30% 0.20% 0.20% 0.20% 0.20% 0.20% 0.20% 0.10% 0.10% Percent Visits 7.40% 4.50% 2.20% 1.40% 0.40% 0.40% 0.90% 0.30% 0.30% 0.30% 0.20% 0.30% 0.20% 0.10% 0.20% 0.20% 0.20% 0.10% 0.10% 0.10% Percent Views 24.80% 10.60% 4.60% 6.30% 1.10% 1.20% 5.40% 1.30% 0.80% 1.30% 0.70% 1.00% 0.60% 0.50% 0.50% 0.40% 0.50% 0.40% 0.30% 0.30% Ranking Domain Visitors Visits Views 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 Unresolved Network (.net) Commercial (.com) United States Educational Australia Canada United States Government Germany United Kingdom India Italy Japan France Brazil United States Organization (.org) Netherlands Mexico Norway United States Military 179,321 147,419 67,396 30,321 12,931 11,711 11,491 8,023 7,930 7,757 7,003 5,847 5,743 4,628 4,262 4,208 4,092 3,919 2,957 1,825 324,426 198,458 95,035 63,066 18,761 18,456 41,661 12,233 13,368 13,736 9,894 12,671 8,994 6,425 7,508 7,042 8,488 5,326 5,022 5,127 3,567,403 1,525,234 666,838 906,374 152,116 170,326 771,731 185,265 117,427 192,448 100,552 147,116 85,346 71,294 75,375 62,264 68,595 62,511 36,611 40,383 February 2011 FY2010 Annual Report 24
Top 20 Countries By # Web Visits The FY2010 Top 20 Countries for visits >= 1 minute is sorted by the # of Visits. Percent Visitors 9.60% 1.30% 1.50% 1.20% 0.80% 0.70% 0.70% 0.50% 0.30% 0.40% 0.50% 0.30% 0.20% 0.20% 0.20% 0.20% 0.20% 0.20% 0.20% 0.20% Percent Visits 8.50% 3,774,349 1.50% 1.20% 1.00% 0.70% 0.60% 0.50% 0.40% 0.40% 0.40% 0.40% 0.40% 0.20% 0.20% 0.20% 0.20% 0.20% 0.20% 0.20% 0.20% Percent Views 26.20% 6.10% 2.60% 2.40% 3.10% 2.20% 1.40% 1.30% 1.50% 1.20% 1.30% 0.90% 0.60% 0.40% 1.00% 0.80% 0.70% 0.40% 0.60% 0.60% Country Country Ranking Visitors Visits Views United States China Great Britain Canada India Germany Australia France Japan Italy Spain Netherlands Sweden Norway Korea, Republic of Russian Federation Brazil Finland Mexico Taiwan 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 225,552 29,656 34,917 27,439 17,757 16,661 16,166 11,395 7,333 10,240 10,743 6,437 5,689 4,706 4,204 4,137 5,117 3,935 5,184 3,711 373,916 66,899 51,991 43,197 32,314 24,443 24,227 19,044 16,747 16,581 16,113 15,510 9,962 8,949 8,630 8,202 7,982 7,814 7,170 7,081 871,600 369,952 351,018 443,584 317,696 194,812 180,129 211,208 172,678 180,745 130,529 83,407 57,117 140,266 111,394 95,301 58,708 83,874 88,671 February 2011 FY2010 Annual Report 25
Total Users and Trends Total Users Data Volume Distribution Trend Data Product Distribution Trend Top 10 Products Trend FY2009-FY2010 Known U.S. - Foreign Product Distribution Trend Web Trends (Visits and Visitors) February 2011 FY2010 Annual Report 26
Total Users Total Users is an estimate formed by combining the distinct Data Users and distinct Web Visitors, removing the overlap. The common element for these counts is the IP address (Host); therefore, the comparison is made without using the additional details provided by the Data User email address or the Web Visitor browser. Not being able to compare the users directly likely results in an undercount. Web Visitors included in the count are for those visitors with visits of one minute or longer. To minimize the undercount, the final Total Users value includes the total Web Visitors (IP address plus browser), plus the distinct Data Users (counted by IP Address). Distinct Web Visitor (1 min+) (by Host IP) 101,676 6,607 1,631 55,117 3,045 17,939 24,098 229,543 10,981 11,372 98,760 560,769 Distinct Data User Distinct Web Visitor (1 min+) Dual Users (Data and Web) % of Data Users using the web Data Center Data Users Only ASDC ASF CDDIS GES DISC GHRC LP DAAC MODAPS NSIDC ORNL PO DAAC SEDAC Total 1,793 468 44,368 50,214 2,751 22,176 121,914 6,524 16,807 21,791 207,982 496,788 129,351 8,779 1,935 81,529 3,477 23,036 37,412 287,305 13,475 14,808 117,837 718,944 1,245 73 43,531 30,392 2,213 19,079 110,100 4,573 12,535 16,469 175,659 415,869 548 395 837 19,822 538 3,097 11,814 1,951 4,272 5,322 32,323 80,919 30.6% 84.4% 1.9% 39.5% 19.6% 14.0% 9.7% 29.9% 25.4% 24.4% 15.5% 16.3% Total distinct users of data and services 1,134,813 February 2011 FY2010 Annual Report 27
Data Volume Distribution Trend The Volume Distribution Trend presents distributed volume counts from EMS by data center. OBPG* distribution metrics from the Ocean Color web site are included beginning in FY2004. CDDIS data became available in FY2009. Fiscal Year FY00 FY01 FY02 FY03 FY04 FY05 FY06 FY07 FY08 FY09 FY10 ASF CDDIS GESDISC GHRC ASDC LP DAAC MODAPS NSIDC ORNL PO.DAAC SEDAC OBPG* Total 0.01 0.14 0.05 1.36 2.35 2.31 1.88 2.16 16.50 41.98 2.66 20.99 45.37 82.97 185.02 278.13 361.22 493.29 192.65 302.80 487.32 698.68 0.63 1.00 1.25 6.49 7.70 7.56 9.10 8.01 12.08 8.63 12.41 6.32 30.38 62.53 107.90 147.01 127.37 204.70 225.24 167.14 187.92 232.71 8.69 25.71 171.32 110.43 209.82 224.27 329.00 431.40 448.12 538.94 952.71 0.00 0.00 0.00 0.00 0.00 0.00 18.48 564.21 813.94 866.75 1,287.38 0.24 0.40 1.36 4.20 15.91 27.11 55.69 69.54 81.32 120.00 140.17 0.01 0.02 0.47 1.21 1.23 1.90 0.95 1.17 0.74 2.86 4.99 1.85 2.73 4.92 28.08 37.49 31.37 36.55 14.06 62.17 91.35 104.92 0.08 0.12 0.17 0.22 0.16 0.17 0.16 0.08 0.06 0.32 1.43 38.82 105.87 325.03 444.90 702.68 791.97 1,173.50 1,544.53 1,964.48 2,429.21 3,629.34 2.90 8.69 23.71 36.01 59.61 73.96 173.85 9.20 17.43 Total Volume (TBs) 71.40 26.63 3,148.43 74.85 1,499.21 3,450.40 3,550.76 515.92 15.55 415.49 2.96 378.71 13,150.33 February 2011 FY2010 Annual Report 28
Data Product Distribution Trend The Product Distribution Trend presents distributed product counts from EMS by data center. OBPG* distribution metrics from the Ocean Color web site are included beginning in FY2004. CDDIS data became available in FY2009. Fiscal Year FY00 FY01 FY02 FY03 FY04 FY05 FY06 FY07 FY08 FY09 FY10 ASF CDDIS GESDISC GHRC ASDC LP DAAC MODAPS NSIDC ORNL PO.DAAC SEDAC OBPG* Total 0.00 0.00 0.00 0.03 0.06 0.06 0.04 0.05 0.30 0.47 0.10 2.34 2.64 5.28 10.92 15.67 26.55 41.41 30.98 38.75 54.50 84.22 0.97 1.03 1.42 4.68 3.40 3.58 4.05 9.29 10.18 5.68 0.66 0.22 0.97 3.68 4.15 6.77 5.70 7.78 7.32 3.57 5.11 4.41 0.62 1.24 4.63 3.72 8.90 15.08 11.93 24.32 16.76 38.83 51.95 0.00 0.00 0.00 0.00 0.00 0.00 1.67 33.36 47.74 47.21 79.76 0.13 0.25 0.40 0.86 0.96 1.80 4.69 8.13 10.73 17.25 22.90 0.01 0.03 0.09 0.11 0.42 0.49 0.36 1.22 0.40 7.70 49.88 1.05 2.08 3.55 10.45 10.30 12.83 13.48 5.71 16.49 31.72 50.33 0.19 0.26 0.26 0.30 0.25 0.26 0.32 0.11 0.07 0.49 3.57 5.52 8.49 19.31 35.21 47.03 68.06 90.64 127.54 155.66 254.66 412.80 0.29 1.71 4.91 7.04 10.67 8.66 12.43 37.06 52.60 Total Products (Millions) 1.11 89.66 313.25 44.94 49.68 177.97 209.72 68.09 60.71 158.01 6.08 45.70 1,224.92 February 2011 FY2010 Annual Report 29
Top 10 Products Trend by Volume FY2009 FY2010 FY2009 Top 10 Products Distributed By Volume* Product Description GBs Files 4,372,203 2,740,625 1,505,551 1,016,617 1,271,568 520,382 5,151,841 776,452 2,799,820 503,350 1 2 3 4 5 6 7 8 9 10 AIRIBRAD MOD021KM MYD021KM MOD09GA AE_L2A MOD02QKM MOD13Q1 MOD09GQ MOD03 MOD02HKM AIRS/Aqua L1B infrared geolocated radian MODIS/Terra Calibrated Radiances 5-Min L1B Swath 1km MODIS/Aqua Calibrated Radiances 5-Min L1B Swath 1km MODIS/Terra Surface Reflectance Daily L2G Global 1km and 500m SIN Grid AMRS-E/Aqua L2A Brightness Temperatures MODIS/Terra Calibrated Radiances 5-Min L1B Swath 250m MODIS/Terra Level 3 16-Day Vegetation Indices - 250m MODIS/Terra Surface Reflectance Daily L2G Global 250m SIN Grid MODIS/Terra L1A Geolocation = 1 km MODIS/Terra Calibrated Radiances 5-Min L1B Swath 500m 196,138.51 165,987.99 129,814.39 92,435.13 76,969.07 76,395.48 73,551.47 70,918.78 70,132.05 69,015.68 FY2010 Top 10 Products Distributed By Volume* Product Description GBs Files 2,850,783 2,378,453 6,432,178 1,707,672 9,320,890 1,629,756 4,865,754 816,726 1,252,625 675,024 1 2 3 4 5 6 7 8 9 10 MOD09GA MOD021KM MOD03 MYD021KM AIRIBRAD MYD09GA MYD03 MOD13Q1 MOD09GQ MOD02HKM MODIS/Terra Surface Reflectance Daily L2G Global 1km and 500m SIN Grid MODIS/Terra Level 1B Calibrated Radiances - 1km MODIS/Terra Geolocation - 1km MODIS/Aqua Level 1B Calibrated Radiances - 1km AIRS/Aqua infrared geolocated radiances MODIS/Aqua Surface Reflectance Daily L2G Global 1km and 500m SIN Grid MODIS/Aqua Geolocation - 1km MODIS/Terra Vegetation Indices 16-Day L3 Global 250m SIN Grid MODIS/Terra Surface Reflectance Daily L2G Global 250m SIN Grid MODIS/Terra Level 1B Calibrated Radiances - 500m 226,826.39 210,100.01 158,329.60 156,542.44 141,685.42 126,802.22 122,261.48 114,249.90 100,876.07 86,922.21 *Some products are inherently larger than other files in size and therefore may skew the results. February 2011 FY2010 Annual Report 30
Top 10 Products Trend by # of Files FY2009 FY2010 FY2009 Top 10 Products Distributed By #Files Product Description Files** 8,563,521 8,045,425 7,218,381 6,340,602 6,246,276 6,053,135 5,495,849 5,467,986 5,151,841 5,025,697 GBs 2,467.65 8,537.75 1,582.00 1,415.80 7,757.08 6,706.02 2,977.94 12.81 73,541.15 5,184.23 1 2 3 4 5 6 7 8 9 10 GNSS_DAILY_D TRMM_3B42 MOD14 MYD14 AIRX2RET MYD04_L2 GNSS_DAILY_O GNSS_IGSTROP MOD13Q1 MOD04_L2 GNSS Daily Compact Observation Data TRMM 3B42 3-Hour 0.25deg x 0.25deg and Other-GPI Calibration Rainfall MODIS/Terra Thermal Anomalies/Fire 5-Min L2 Swath 1km MODIS/Aqua Thermal Anomalies/Fire 5-Min L2 Swath 1km AIRS/Aqua FINAL Level 2 Products (Without HSB) MODIS/Aqua Level 2 Aerosol GNSS Daily Observation Data GNSS Final Troposphere Zenith Path Delay Product MODIS/Terra Level 3 16-Day Vegetation Indices - 250m MODIS/Terra Aerosol 5-MIN L2 Swath 10KM FY2010 Top 10 Products Distributed By #Files Product Description Files** 47,126,600 15,365,035 12,207,462 12,004,610 9,906,940 9,506,179 9,320,890 141,685.42 7,170,225 6,810,203 6,432,178 158,329.60 GBs 2,782.47 5,158.29 14,338.23 15,691.49 11,740.50 9,297.75 1 2 3 4 5 6 7 8 9 10 MOD13Q1 GNSS_DAILY_D MOD04_L2 GHRSST_248 MYD04_L2 GHRSST_250 AIRIBRAD TRMM_3B42 GNSS_DAILY_O MOD03 MODIS/Terra Vegetation Indices 16-Day L3 Global 250m ISIN Grid GNSS Daily Compact Observation Data MODIS/Terra Level 2 Aerosol GHRSST Level 2P USA NASA MODIS Aqua 11 micron SST MODIS/Aqua Level 2 Aerosol GHRSST Level 2P USA NASA MODIS Terra 11 micron SST AIRS/Aqua infrared geolocated radiances TRMM 3B42 3-Hour 0.25deg x 0.25deg and Other-GPI Calibration Rainfall GNSS Daily Observation Data MODIS/Terra Geolocation - 1km 8,949.83 4,584.40 ** When counting # of files, metadata files are not included. February 2011 FY2010 Annual Report 31
Known U.S. - Foreign Product Distribution Trend Country FY2007 35,960,845 65,563,006 FY2008 56,769,710 120,843,195 152,842,193 69,857,119 113,052,619 242,093,094 FY2009 FY2010 Foreign U.S. * Does not include product distribution where the destination country could not be determined February 2011 FY2010 Annual Report 32
Web Trends Web metrics data for EOSDIS became available as of FY2007. Data for FY2007 is complete for 7 and FY2008 is complete for 8 of the 11 data centers providing the metrics for FY2009 and FY2010. These web metrics are for visits of one minute or more. Fiscal Year FY2007 FY2008 FY2009 FY2010 Views 7,599,722 8,263,283 11,463,765 13,654,146 Visits Visitors Repeat Visitors 707,365 827,714 1,079,317 1,108,858 443,079 523,416 702,058 718,944 77,731 91,801 116,886 205,378 February 2011 FY2010 Annual Report 33
Definitions (1 of 2) EMS Term Definition EOSDIS element serving as a source of metrics information for describing the ingest, archive and distribution of EOSDIS science data; web activity metrics are also collected. For the EOSDIS annual reporting, metrics from individual data providers at a single site are combined (e.g., NSIDC = NSIDCECS + NSIDCV0). Metrics describing the ingest, archive and distribution of EOSDIS science data at EOSDIS Data Centers. This EOSDIS Annual Report presents data metrics from EOSDIS Data Centers. Most metrics can be found in the EMS HTMLDB interface (http://ops1.ems.eosdis.nasa.gov: 8000/pls/apex/f?p=111). Metrics from other sources are noted in the report where applicable. Metrics describing the web activity at EOSDIS Data Center web sites and EOSDIS related web sites. This EOSDIS Annual Report presents web metrics by EOSDIS Data Centers. These metrics can be found in the EMS NetInsight interface (https://ems.eos.nasa.gov/NetInsight/index.html). Designates the type of business or organization accessing EOSDIS. The domain is determined from the IP address and country. Data Provider Data Metrics Web Metrics Domain EMS Data File Term Definition Ingest is the amount of data coming into a data center over a period of time and includes all product levels. Ingest Archive is the amount of data added to the archive over a period of time and includes all products levels. Archive The Total Archive Size describes the EOSDIS archive at the end of the fiscal year. This includes all data (including ancillary) but not data marked for deletion. Any individual requesting data as defined by an IP address plus email, within the time period. The number of distinct (i.e., counted once) users receiving data during the report period. The smallest unit of data inventoried and distributed to users; typically, a granule is a single data file, though some granules may include multiple files. EMS counts individual files as distinct products. This is roughly equivalent to counting EOS granules, although in the case of some EOS instrument data, a granule may contain more than one file. If so, the files are counted as individual products. The number of files successfully delivered to Public users. This count excludes METADATA file types. If the file type does not distinguish a file as a metadata or a science file, i.e., it is encoded as n/a, then the default process is to count the file as a science data product. Total Archive Size Data User Distinct Users Granule Product Number of Products Delivered Volume of Products Delivered The volume of data (in MBs) successfully delivered to Public users. This includes all file types, including METADATA. February 2011 FY2010 Annual Report 34
Definitions (2 of 2) EMS Data File Term Definition Any individual defined by an IP Address who requests and receives data for purposes other than product generation and quality assurance/testing. Any identified and authorized user who requests data for the purposes of quality assurance/testing. Any identified and authorized user who requests data for the purposes of product generation. All distinct Public users requesting data within the time period. Distinct Public users requesting data more than once during the time period. If the user is requesting data for the first time ever within the specific time period and then requests data again during the specific time period, he/she would be counted as a repeat user. Public User QA/Test User Production User All Users Repeat Users EMS Web File Term Definition Any individual defined by IP Address+browser that views a web page. A visitor can also become a 'Data User' once data is requested. The number of distinct (i.e., counted once) visitors to a provider's web sites during the time period. Hit by a user during a session to a web page, excluding error hits and hits to user-defined files such as inline images (.JPG, .GIF, etc.), Java applets, and specific redirects or services provided by the data provider. A series of consecutive views of a website by the same user without continuous interruption of more than 30 minutes. If a user does not view a new page in a specified time, the next page viewed by that user is considered the start of a new visit. The number of page views to a provider's web pages over the time period. The number of visits over the time period. All distinct visitors viewing a web page during the report time period. Visitors who view a web page during a specific time period who have accessed the system before. If the visitor accesses the system for the first time ever within the time period and then accesses the system again during the specific time period, he/she would be counted as a repeat visitor. Definition Metrics data directly from the EMS tools, presented by data provider as available. Visitor Distinct Visitors View Visit EMS Web Views EMS Web Visits All Visitors Repeat Visitors Report Term Stage 1 Stage 2 Metrics data grouped by data center , augmented with external data, includes all twelve data centers. Metrics data presented by the major contributing data centers, often accompanied by a graphic. Stage 3 February 2011 FY2010 Annual Report 35