EOSDIS FY2009 Annual Metrics Report Summary
The Earth Sciences Data and Information System (ESDIS) Project presents the EOSDIS FY2009 Annual Metrics Report, covering data and web activity at the EOSDIS data centers from October 1, 2008, to September 30, 2009. The report includes statistics on unique data sets, distinct users of EOSDIS data and services, web site visits, average archive growth, total archive volume, end-user distribution products, and end-user average distribution volume. Key metrics for FY2009 include over 4,000 unique data sets, more than 910K distinct users, web site visits exceeding 1M, an average archive growth of 1.8TB/day, a total archive volume of 4.2 PB, and more. Detailed statistics and comparisons are provided to analyze trends in EOSDIS performance.
Download Presentation
Please find below an Image/Link to download the presentation.
The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author. Download presentation by click this link. If you encounter any issues during the download, it is possible that the publisher has removed the file from their server.
E N D
Presentation Transcript
EOSDIS FY2009 Annual Metrics Report Prepared By: Hyo Duck Chang Adnet, Inc. Brian Krupp Adnet, Inc. Lalit Wanchoo Adnet, Inc. March 2010
Preface The Earth Sciences Data and Information System (ESDIS) Project (Code 423) is pleased to present the following report on metrics from across the Earth Observation System Data and Information System (EOSDIS). The 12 Data Centers of EOSDIS support different scientific disciplines and provide an individualized set of products and services to their science community and the public. Although discipline oriented, the data centers engage in common data management functions of ingest, archive and distribution, as well as describing their data and services on web sites. Metrics are collected on a daily basis from each data center. The ESDIS Project collects these metrics in a tool called the ESDIS Metrics System (EMS). Data center analysts can view their detailed metrics to assess internal performance and trends. The ESDIS project combines these metrics, not for comparisons between the data centers, but as a system level view of EOSDIS performance. This report provides snapshots of metrics as the combination of the individual data centers and from a purely system perspective. The EOSDIS Annual Report for FY2009 (Oct. 1, 2008 Sept. 30, 2009) presents a best effort to combine and present information from the collected metrics data. Some data centers are in the process of developing their interfaces with the EMS and testing is not yet complete. Therefore, some data centers do not yet deliver metrics data in all parameter categories these will be added in future reports. In keeping with previous years, and in order to support trend comparisons, the metrics data are presented on a fiscal year basis, not by calendar year. If you have any questions or comments please contact Jeanne Behnke at (301) 614-5326 or jeanne.behnke@nasa.gov or Kevin Murphy at (301) 614-5580 or kevin.j.murphy@nasa.gov. March 2010 FY2009 Annual Report 2
Introduction This report presents statistics on data metrics and web activity at the EOSDIS data centers during Fiscal Year 2009 (October 1, 2008 through September 30, 2009) from the Earth Science Data and Information System (ESDIS) Metrics System (EMS). EMS supports the ESDIS project management by collecting and organizing various metrics from the Earth Observing System (EOS) Data and Information System (DIS) Data Centers and other Data Providers. The EMS collects and presents data on the usage of products and services delivered via the Internet or managed in EOSDIS archives. EMS consists of a Data Metrics component and a Web Metrics component. The Data Metrics component provides statistics on data ingest, archive and distribution plus data users profile information collected from Data Providers. The Web Metrics component provides statistics on web site visits, views and visitors with a variety of related parameters. This report contains tables and graphs of FY2009 statistics and comparisons to previous years. Values for previous fiscal years are produced from EMS. Summary tables, text, graphs, and more detailed statistics tables are also included. Definitions for terms used in this report can be found at the end of this presentation. March 2010 FY2009 Annual Report 3
Summary EOSDIS Metrics (Oct. 1, 2008 to Sept. 30, 2009) Unique Data Sets Distinct Users of EOSDIS Data and Services Web Site Visits Average Archive Growth Total Archive Volume End User Distribution Products End User Average Distribution Volume > 4,000 > 910K > 1M 1.8TB/day 4.2 PB > 254M 6.7 TB/day Unique Data Sets: Total number of unique data sets distributed in the fiscal year Distinct Users of EOSDIS Data and Services: Total unique users across EOSDIS Data Users and Web Visitors, per data center and summed Web Site Visits: Sum of web visits for data centers where a visit represents a user session not broken by more than 30 minutes and a duration of at least one minute Average Archive Growth: Sum across reporting data centers of the data volume added to the individual archives divided by the days in the year Total Archive Volume: Sum across reporting data centers of the data volumes in the archive as of end of the fiscal year End User Distribution Products: Total number of products distributed from all reporting data centers End User Average Distribution Volume: Sum across reporting data centers of the data volume distributed for the fiscal year divided by the days in the year March 2010 FY2009 Annual Report 4
Data Metrics Ingest Archive Total Archive Data Users Distinct Users Repeat Users Top 20 Countries Distribution By Data Center Volume by Domain Products by Domain Top 20 Countries Top 10 Products March 2010 FY2009 Annual Report 5
Ingest Ingest is the amount of data coming into a data center over a period of time and includes all product levels. For this report, the data is presented as the amount of data entered into each data center during FY2009. The sum of all data centers is the total ingest for EOSDIS. Only the major contributors (excluding LaTIS which is not available) are included in the count. Data Ingested by Data Center ASDC GESDISC GHRC LPDAAC MODAPS NSIDC PODAAC Total Volume (TBs) Files (Millions) 100.33 110.49 5.50 107.44 48.76 13.04 1.74 387.30 2.13 7.76 0.44 9.58 0.25 3.62 0.22 24.01 March 2010 FY2009 Annual Report 6
Archive Archive is the amount of data added to the archive over a period of time and includes all products levels. SEDAC values represent very small amounts of data and are not counted. LaTIS, OBPG, and CDDIS data are not available at this time. Data Archived by Data Center ASDC ASF GESDISC GHRC LPDAAC MODAPS NSIDC PODAAC ORNL Total Volume (TBs) Files (Millions) 107.67 4.84 139.61 1.90 103.59 267.60 12.37 8.62 0.01 646.21 6.68 0.00 14.30 0.14 9.58 6.71 3.10 0.64 0.00 41.16 March 2010 FY2009 Annual Report 7
Total Archive Size The Total Archive Size describes the EOSDIS archive at the end of FY2009. These data account for all data (including ancillary data) but not data marked for deletion. Volume (TBs) 2,359.02 376.69 317.83 Files (Millions) Total Archive Size ASDC ASF GESDISC GHRC LPDAAC MODAPS NSIDC PODAAC ORNL Total 68.34 0.13 31.92 0.33 38.75 18.46 15.02 2.13 0.14 175.22 5.33 759.51 392.53 63.57 29.62 0.39 4,304.49 March 2010 FY2009 Annual Report 8
Distribution By Data Center Distribution presents the amount of data successfully distributed to Public Users. Distribution by Data Center Total Volume (TBs) Products (Millions) MODAPS /LAADS ASF CDDIS GESDISC GHRC ASDC LPDAAC NSIDC ORNL PO.DAAC SEDAC OBPG* Total 41.98 9.20 487.32 8.63 187.92 538.94 866.75 120.00 2.86 91.35 0.32 73.96 2,429.21 0.47 37.06 54.50 5.68 5.11 38.83 47.21 17.25 7.70 31.72 0.49 8.66 254.66 *OBPG data taken from the Ocean Color web site March 2010 FY2009 Annual Report 9
Volume Distribution By Domain Volume Distribution presents the volume of data successfully distributed to Public Users by Domain. Total Volume Distributed Foreign US GOV US EDU US COM US ORG US Other Unknown Total Volume (TBs) GES DISC LP DAACMODAPS ASF CDDIS GHRC ASDC NSIDC ORNL PO.DAAC SEDAC OBPG* Total /LAADS 0.23 20.72 7.88 11.23 1.56 0.16 0.20 6.77 1.49 0.42 0.17 0.04 0.23 0.08 85.39 98.54 237.75 5.25 3.24 27.45 29.71 2.54 1.50 2.70 0.53 0.00 0.94 0.42 43.66 47.63 26.92 4.80 0.05 54.19 10.66 283.49 60.70 94.55 85.02 3.56 4.41 7.21 362.01 271.14 139.82 21.51 2.68 35.45 34.13 56.82 26.29 15.81 5.58 0.71 12.01 2.78 1.05 0.38 0.88 0.18 0.00 0.24 0.13 44.48 23.87 10.19 1.33 0.00 8.75 2.73 0.13 0.01 0.02 0.06 0.00 0.01 0.08 0.00 0.00 0.00 0.00 0.00 0.00 73.96 886.57 552.27 536.94 135.65 11.86 143.82 162.09 41.98 9.20 487.32 8.63 187.92 538.94 866.75 120.00 2.86 91.35 0.32 73.96 2,429.21 *OBPG data taken from the Ocean Color web site March 2010 FY2009 Annual Report 10
Product Distribution By Domain Product Distribution presents the number of products successfully distributed to Public Users by Domain. Total Products Distributed Foreign US GOV US EDU US COM US ORG US Other Unknown Total Products (Millions) MODAPS /LAADS ASF CDDIS GES DISC GHRC ASDC LP DAAC NSIDC ORNL PO.DAAC SEDAC OBPG* Total 0.02 0.04 0.04 0.34 0.02 0.01 0.01 27.73 3.44 3.44 0.81 0.27 0.70 0.67 18.01 12.31 16.40 1.56 0.10 2.36 3.76 0.86 0.18 4.14 0.09 0.00 0.18 0.23 1.71 0.60 0.64 0.18 0.00 1.40 0.58 25.96 5.19 3.71 3.07 0.13 0.46 0.32 19.49 12.70 8.46 0.57 0.04 1.84 4.11 9.42 1.65 2.15 0.79 0.09 2.61 0.55 0.64 1.85 2.26 0.24 0.00 2.70 0.01 16.78 5.35 3.47 0.77 0.00 3.57 1.79 0.23 0.01 0.04 0.10 0.01 0.02 0.09 0.00 0.00 0.00 0.00 0.00 0.00 8.66 120.84 43.30 44.76 8.50 0.66 15.84 20.77 0.47 37.06 54.50 5.68 5.11 38.83 47.21 17.25 7.70 31.72 0.49 8.66 254.66 *OBPG data taken from the Ocean Color web site March 2010 FY2009 Annual Report 11
Data Distribution - Top 20 Countries Top 20 Countries by Volume Distributed* Top 20 Countries by Products Distributed** Volume (GBs) 1,415,908.80 168,926.42 124,047.27 103,114.57 60,052.70 55,672.83 50,838.72 49,663.24 47,396.96 47,248.45 22,138.77 13,860.95 9,099.98 8,501.89 7,423.99 7,351.75 7,143.62 6,428.68 4,877.96 4868.135 Country Country Products 112,972,155 17,189,007 16,763,692 16,073,789 6,087,172 6,048,612 5,827,522 5,203,989 4,653,771 4,190,711 4,140,627 3,272,456 2,931,420 2,798,363 2,700,752 2,391,585 2,029,192 1,728,399 1,711,704 1,384,511 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 USA JAPAN CHINA FRANCE BELGIUM CANADA UNITED KINGDOM KOREA, SOUTH AUSTRALIA GERMANY ITALY BRAZIL NETHERLANDS SPAIN TAIWAN RUSSIA DENMARK INDIA HONG KONG NORWAY 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 USA JAPAN CHINA UNITED KINGDOM GERMANY FRANCE KOREA, SOUTH BRAZIL ITALY DENMARK CANADA AUSTRALIA FINLAND LUXEMBOURG RUSSIA TAIWAN BELGIUM INDIA SPAIN SOUTH AFRICA * Some products are inherently larger than other files in size and therefore may skew the results. ** When counting # of files, metadata files are not included. March 2010 FY2009 Annual Report 12
Data Distribution - Top 10 Products Top 10 Products Distributed By Volume* Product Description GBs Files** 4,372,203 2,737,878 1,503,596 1,016,617 1,271,568 519,740 5,151,841 776,452 2,794,966 502,744 1 2 3 4 5 6 7 8 9 10 AIRIBRAD MOD021KM MYD021KM MOD09GA AE_L2A MOD02QKM MOD13Q1 MOD09GQ MOD03 MOD02HKM AIRS/Aqua L1B infrared geolocated radian MODIS/Terra Calibrated Radiances 5-Min L1B Swath 1km MODIS/Aqua Calibrated Radiances 5-Min L1B Swath 1km MODIS/Terra Surface Reflectance Daily L2G Global 1KM and 500M SIN Grid AMRS-E/Aqua L2A Brightness Temperatures MODIS/Terra Calibrated Radiances 5-Min L1B Swath 250m MODIS/Terra Level 3 16-Day Vegetation Indices - 250m MODIS/Terra Surface Reflectance Daily L2G Global 250m SIN Grid MODIS/Terra L1A Geolocation = 1 km MODIS/Terra Calibrated Radiances 5-Min L1B Swath 500m 196,138.51 165,646.10 129,571.26 92,427.60 76,964.52 76,299.11 73,541.15 70,913.81 70,032.22 68,932.64 * Some products are inherently larger than other files in size and therefore may skew the results. Top 10 Products Distributed By Files** Product Description Files** 8,563,521 8,045,425 7,218,381 6,340,602 6,246,276 6,053,135 5,495,849 5,467,986 5,151,841 5,025,697 GBs 2,467.65 8,537.75 1,582.00 1,415.80 7,757.08 6,706.02 2,977.94 12.81 73,541.15 5,184.23 1 2 3 4 5 6 7 8 9 10 GNSS_DAILY_D TRMM_3B42 MOD14 MYD14 AIRX2RET MYD04_L2 GNSS_DAILY_O GNSS_IGSTROP MOD13Q1 MOD04_L2 GNSS Daily Compact Observation Data TRMM 3B42 3-Hour 0.25deg x 0.25deg and Other-GPI Calibration Rainfall MODIS/Terra Thermal Anomalies/Fire 5-Min L2 Swath 1km MODIS/Aqua Thermal Anomalies/Fire 5-Min L2 Swath 1km AIRS/Aqua FINAL Level 2 Products (Without HSB) MODIS/Aqua Level 2 Aerosol GNSS Daily Observation Data GNSS Final Troposphere Zenith Path Delay Product MODIS/Terra Level 3 16-Day Vegetation Indices - 250m MODIS/Terra Aerosol 5-MIN L2 Swath 10KM ** When counting # of files, metadata files are not included. March 2010 FY2009 Annual Report 13
Distinct Data Users Distinct Data Users presents the number of distinct public users* who received data product files. Distinct Data Users By Domain Foreign US GOV US EDU US COM US ORG US Other Unknown Total Distinct Data Users GES DISC LP DAACMODAPS ASF CDDIS GHRC ASDC NSIDC ORNL PO.DAAC SEDAC Total /LAADS 8,751 22,355 1,274 933 3,310 102 1,848 1,437 17,857 3,797 4,412 7,213 191 2,117 2,383 1,346 149 225 428 686 200 254 161 11,114 661 1,876 3,801 176 403 443 59,207 1,038 1,572 2,126 6,221 602 1,600 2,727 8,696 444 1,687 2,480 13,688 1,145 1,824 2,487 42,394 450 2,749 15,589 311 3,427 7,799 192,315 9,809 17,303 41,849 1,013 11,737 17,513 49 171 1,527 23 258 5 6 35 781 71 837 770 51 841 772 42 850 190 522 185 29 1,092 1,143 1,123 11,871 31,259 37,970 2,865 1,521 18,474 65,902 12,828 14,971 21,159 72,719 291,539 * Does not include OBPG users March 2010 FY2009 Annual Report 14
Repeat Data Users Repeat users are distinct Public users* who received data on more than one day in the fiscal year. Repeat Data Users By Domain Foreign US GOV US EDU US COM US ORG US Other Unknown Total Repeat Data Users GES DISC LP DAACMODAPS ASF CDDIS GHRC ASDC NSIDC ORNL PO.DAAC SEDAC Total /LAADS 270 24 57 243 6,994 621 407 1,276 4,002 952 1,180 706 276 50 70 110 285 112 95 59 4,353 303 817 1,535 4,149 423 520 700 1,563 258 535 437 1,319 120 347 552 3,363 428 542 364 4,216 117 283 1,106 30,790 3,408 4,853 7,088 308 2,934 3,050 6 57 869 556 36 389 471 1 3 81 115 128 11 314 195 31 169 145 10 124 89 7 65 599 39 50 33 129 96 15 187 248 1,024 689 10,780 7,736 669 665 7,332 6,312 3,138 2,561 5,139 7,410 52,431 * Does not include OBPG users March 2010 FY2009 Annual Report 15
Data Users - Top 20 Countries Top 20 Countries by Number of Users Country Users 78,538 50,317 9,470 8,098 7,653 6,356 4,956 4,951 4,856 4,264 3,542 3,235 2,884 2,357 2,168 1,933 1,744 1,337 1,325 1,189 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 USA CHINA UNITED KINGDOM GERMANY CANADA JAPAN AUSTRALIA FRANCE INDIA ITALY SPAIN RUSSIA BRAZIL KOREA, SOUTH NETHERLANDS CHILE TAIWAN POLAND ARGENTINA UKRAINE March 2010 FY2009 Annual Report 16
Foreign Distribution Foreign Country # of Users # of Products (1000s) Vol (TBs) EU Canada China Japan Other 43,786 7,653 50,317 6,356 84,203 50,268 4,141 16,764 17,189 32,482 319.46 54.37 121.14 164.97 226.67 EU includes 27 European Union member countries. China includes only People s Republic of China and does not include Taiwan. March 2010 FY2009 Annual Report 17
Web Metrics Visitors and Visits Repeat Visitors Top 20 Domains Top 20 Countries March 2010 FY2009 Annual Report 18
Web Visitors and Visits EOSIDS web activity is measured by the number of Visits made, the number of pages Viewed and the number of distinct Visitors. Visits, Views, and Visitors count visits greater than or equal to 1 minute. Visits of at least one minute are considered to represent significant work accomplished, and many of the shorter visits are of less than a second. # Unique Visitors Month # Visits # Views Oct-08 Nov-08 Dec-08 Jan-09 Feb-09 Mar-09 Apr-09 May-09 Jun-09 Jul-09 Aug-09 Sep-09 101,157 95,149 85,076 95,925 104,115 104,267 100,596 85,957 77,291 77,992 73,256 78,536 912,590 873,274 845,467 971,734 983,594 1,025,714 1,096,707 936,211 864,837 1,083,830 1,021,196 848,611 71,591 68,622 61,036 69,596 75,899 76,029 73,019 60,277 53,625 53,813 51,027 56,674 1,079,317 11,463,765 771,208 FY2009 March 2010 FY2009 Annual Report 19
Repeat Web Visitors EOSDIS Web Visitors are characterized by the number of visits they make and how frequently they return. Visitors counted in the table below are those that stayed for one minute or more. Repeat Visitors are counted from the start of the Fiscal Year. FY2009 Web Visitors for Visits of one minute or more Total Visitors # of Visits All DAACs 2 3 4 9,926 5-6 9,367 7-9 5,760 10 - 14 3,528 15 - 24 2,236 25 - 49 1,128 50 - 99 100+ 63,398 21,096 338 109 116,886 March 2010 FY2009 Annual Report 20
Top 20 Domains By # Web Visitors The FY2009 Top 20 Domains for visits >= 1 minute is sorted by the # of Visitors. Domains are as defined by NetInsight. Percent Visitors 10.80% 6.20% 2.60% 1.30% 0.60% 0.60% 0.50% 0.30% 0.30% 0.30% 0.20% 0.20% 0.20% 0.20% 0.10% 0.10% 0.10% 0.10% 0.10% 0.10% Percent Visits 10.10% 4.60% 2.10% 1.60% 0.50% 0.50% 1.10% 0.30% 0.30% 0.30% 0.20% 0.20% 0.20% 0.10% 0.10% 0.10% 0.10% 0.10% 0.10% 0.10% Percent Views 29.20% 10.70% 4.90% 5.40% 1.40% 1.40% 4.20% 1.30% 0.80% 1.00% 0.70% 0.90% 0.60% 0.40% 0.30% 0.40% 0.40% 0.30% 0.40% 0.30% Domain Domain Visitors Visits Views Ranking 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 Unresolved Network (.net) Commercial (.com) United States Educational Australia Canada United States Government Japan United Kingdom United States India Organization (.org) Germany Brazil Mexico China Italy Argentina France United States Military 233,833 134,644 55,489 28,791 12,354 11,931 11,122 5,999 5,942 5,662 4,838 4,717 4,004 3,927 3,125 2,714 2,683 2,598 2,303 1,914 388,998 177,531 82,253 60,242 18,367 19,293 42,904 13,401 10,598 10,276 9,203 8,838 7,165 5,541 4,220 4,242 4,691 3,931 4,457 4,739 3,631,804 1,334,439 607,516 668,623 170,835 170,778 526,023 158,687 101,622 121,426 92,580 109,020 68,314 50,083 42,610 46,733 53,356 42,622 49,349 38,642 March 2010 FY2009 Annual Report 21
Top 20 Countries By # Web Visits The FY2009 Top 20 Countries for visits >= 1 minute is sorted by the # of Visits. Percent Visitors 11.70% 1.20% 1.60% 1.50% 0.80% 0.60% 0.70% 0.50% 0.50% 0.40% 0.50% 0.30% 0.20% 0.20% 0.20% 0.20% 0.20% 0.10% 0.10% 0.20% Percent Visits 10.80% 3,719,209 1.50% 1.40% 1.20% 0.70% 0.60% 0.60% 0.50% 0.50% 0.50% 0.40% 0.40% 0.20% 0.20% 0.20% 0.20% 0.20% 0.20% 0.20% 0.20% Percent Views 29.90% 5.50% 3.10% 3.20% 1.80% 2.00% 1.70% 1.50% 1.50% 1.70% 1.40% 1.00% 0.50% 0.50% 0.60% 0.70% 0.80% 0.30% 0.40% 0.50% Country Country Visitors Visits Views United States China Great Britain Canada Australia India Germany France Italy Japan Spain Netherlands Sweden Norway Brazil Russian Federation Korea, Republic of Ireland Finland Mexico 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 253,601 26,020 35,213 31,698 16,820 13,394 15,897 11,330 10,501 7,697 10,634 6,118 5,253 4,330 5,354 3,802 3,438 2,564 3,119 4,349 414,360 56,503 52,727 47,692 25,800 24,701 23,169 18,737 17,634 17,613 16,293 15,929 9,473 8,263 7,970 7,561 7,033 6,621 6,287 6,267 680,526 384,073 402,576 229,413 251,488 209,600 181,208 184,526 207,149 176,779 123,040 64,146 56,669 73,340 82,632 96,574 36,475 48,626 65,896 March 2010 FY2009 Annual Report 22
Total Users and Trends Total Users Data Volume Distribution Trend Data Product Distribution Trend Top 10 Products Trend FY2008-FY2009 Known U.S. - Foreign Product Distribution Trend Web Trends (Visits and Visitors) March 2010 FY2009 Annual Report 23
Total Users Total Users is an estimate formed by combining the distinct Data Users and distinct Web Visitors, removing the overlap. The common element for these counts is the IP address (Host); therefore, the comparison is made without using the additional details provided by the Data User email address or the Web Visitor browser. Not being able to compare the users directly likely results in an undercount. Web Visitors included in the count are for those visitors with visits of one minute or longer. To minimize the undercount, the final Total Users value includes the total Web Visitors (IP address plus browser), plus the distinct Data Users (counted by IP Address). Distinct Web Visitor (1 min+) (by Host IP) 1,861 860 61,119 1,702 89,050 27,580 18,935 234,115 11,463 11,474 104,944 563,103 Distinct Data User Distinct Web Visitor (1 min+) Data Users OnlyDual Users % of Data Users using the web Data Center (Data and Web) ASF CDDIS GES DISC GHRC LaRC LP DAAC MODAPS NSIDC ORNL PO DAAC SEDAC Total 11,862 25,716 26,992 2,525 971 11,346 58,567 11,441 12,915 17,981 71,695 252,011 2,548 979 80,801 2,011 109,905 34,902 29,103 289,997 13,974 14,634 123,204 702,058 11,696 25,281 16,653 2,216 640 8,542 49,667 10,283 9,584 13,567 61,818 209,947 166 435 10,339 309 331 2,804 8,900 1,158 3,331 4,414 9,877 42,064 1.4% 1.7% 38.3% 12.2% 34.1% 24.7% 15.2% 10.1% 25.8% 24.5% 13.8% 16.7% Total distinct users of data and services 912,005 March 2010 FY2009 Annual Report 24
Data Volume Distribution Trend The Volume Distribution Trend presents distributed volume counts from EMS by data center. OBPG* distribution metrics from the Ocean Color web site are included beginning in FY2004. Volume Distributed (TBs) FY00 FY01 FY02 FY03 FY04 FY05 FY06 FY07 FY08 FY09 Total Volume (TBs) LP DAACMODAPS ASF CDDIS GESDISC GHRC ASDC NSIDC ORNL PO.DAAC SEDAC OBPG* Total /LAADS 0.01 0.14 0.05 1.36 2.35 2.31 1.88 2.16 16.50 41.98 20.99 45.37 82.97 185.02 278.13 361.22 493.29 192.65 302.80 487.32 0.63 1.00 1.25 6.49 7.70 7.56 9.10 8.01 12.08 8.63 6.32 30.38 62.53 107.90 147.01 127.37 204.70 225.24 167.14 187.92 8.69 25.71 171.32 110.43 209.82 224.27 329.00 431.40 448.12 538.94 0.00 0.00 0.00 0.00 0.00 0.00 18.48 564.21 813.94 866.75 0.24 0.40 1.36 4.20 15.91 27.11 55.69 69.54 81.32 120.00 0.01 0.02 0.47 1.21 1.23 1.90 0.95 1.17 0.74 2.86 1.85 2.73 4.92 28.08 37.49 31.37 36.55 14.06 62.17 91.35 0.08 0.12 0.17 0.22 0.16 0.17 0.16 0.08 0.06 0.32 38.82 105.87 325.03 444.90 702.75 792.18 1,174.07 1,545.40 1,965.91 2,429.21 2.97 8.90 24.28 36.88 61.04 73.96 9.20 68.74 9.20 2,449.76 62.44 1,266.50 2,497.70 2,263.38 375.75 10.56 310.57 1.53 208.01 9,524.13 March 2010 FY2009 Annual Report 25
Data Product Distribution Trend The Product Distribution Trend presents distributed product counts from EMS by data center. OBPG* distribution metrics from the Ocean Color web site are included beginning in FY2004. Products Distributed (Millions) FY00 FY01 FY02 FY03 FY04 FY05 FY06 FY07 FY08 FY09 Total Products (Millions) MODAPS /LAADS Total Products ASF CDDIS GESDISC GHRC ASDC LPDAAC NSIDC ORNL PO.DAAC SEDAC OBPG* 0.00 0.00 0.00 0.03 0.06 0.06 0.04 0.05 0.30 0.47 2.34 2.64 5.28 10.92 15.67 26.55 41.41 30.98 38.75 54.50 0.97 1.03 1.42 4.68 3.40 3.58 4.05 9.29 10.18 5.68 0.22 0.97 3.68 4.15 6.77 5.70 7.78 7.32 3.57 5.11 0.62 1.24 4.63 3.72 8.90 15.08 11.93 24.32 16.76 38.83 0.00 0.00 0.00 0.00 0.00 0.00 1.67 33.36 47.74 47.21 0.13 0.25 0.40 0.86 0.96 1.80 4.69 8.13 10.73 17.25 0.01 0.03 0.09 0.11 0.42 0.49 0.36 1.22 0.40 7.70 1.05 2.08 3.55 10.45 10.30 12.83 13.48 5.71 16.49 31.72 0.19 0.26 0.26 0.30 0.25 0.26 0.32 0.11 0.07 0.49 5.52 8.49 19.31 35.21 47.03 68.06 90.64 127.54 155.66 254.66 0.29 1.71 4.91 7.04 10.67 8.66 37.06 1.01 37.06 229.03 44.28 45.27 126.03 129.97 45.19 10.82 107.68 2.51 33.28 812.12 March 2010 FY2009 Annual Report 26
Top 10 Products Trend by Volume FY2008 FY2009 FY2008 Top 10 Products Distributed By Volume* Product Description GBs Files 2,771,007 2,903,073 722,931 976,410 571,815 2,361,609 364,638 1,937,871 1,287,054 1,050,686 1 2 3 4 5 6 7 8 9 10 MOD021KM AIRIBRAD MOD02HKM MOD13Q1 MOD02QKM MYD021KM MYD02QKM MOD03 MOD09A1 AE_L2A MODIS/Terra Calibrated Radiances 5-Min L1B Swath 1km AIRS/Aqua L1B infrared geolocated radian MODIS/Terra Calibrated Radiances 5-Min L1B Swath 500m MODIS/Terra Level 3 16-Day Vegetation Indices - 250m MODIS/Terra Calibrated Radiances 5-Min L1B Swath 250m MODIS/Aqua Calibrated Radiances 5-Min L1B Swath 1km MODIS/Aqua Calibrated Radiances 5-Min L1B Swath 250m MODIS/Terra L1A Geolocation = 1 km MODIS/Terra Level 3 8-Day Surface Reflectance - 500m AMRS-E/Aqua L2A Brightness Temperatures 124,618.63 111,146.03 102,767.58 93,648.47 86,588.36 82,150.44 60,130.46 49,630.35 46,681.83 45,379.45 FY2009 Top 10 Products Distributed By Volume* Product Description GBs Files 4,372,203 2,740,625 1,505,551 1,016,617 1,271,568 520,382 5,151,841 776,452 2,799,820 503,350 1 2 3 4 5 6 7 8 9 10 AIRIBRAD MOD021KM MYD021KM MOD09GA AE_L2A MOD02QKM MOD13Q1 MOD09GQ MOD03 MOD02HKM AIRS/Aqua L1B infrared geolocated radian MODIS/Terra Calibrated Radiances 5-Min L1B Swath 1km MODIS/Aqua Calibrated Radiances 5-Min L1B Swath 1km MODIS/Terra Surface Reflectance Daily L2G Global 1km and 500m SIN Grid AMRS-E/Aqua L2A Brightness Temperatures MODIS/Terra Calibrated Radiances 5-Min L1B Swath 250m MODIS/Terra Level 3 16-Day Vegetation Indices - 250m MODIS/Terra Surface Reflectance Daily L2G Global 250m SIN Grid MODIS/Terra L1A Geolocation = 1 km MODIS/Terra Calibrated Radiances 5-Min L1B Swath 500m 196,138.51 165,987.99 129,814.39 92,435.13 76,969.07 76,395.48 73,551.47 70,918.78 70,132.05 69,015.68 *Some products are inherently larger than other files in size and therefore may skew the results. March 2010 FY2009 Annual Report 27
Top 10 Products Trend by #Files FY2008 FY2009 FY2008 Top 10 Products Distributed By # of Files Product Description Files 9,410,738 5,320,157 4,710,287 3,611,579 3,053,976 2,901,691 111,146.01 2,775,012 2,771,007 124,618.63 2,496,794 2,485,467 GBs 16,731.67 5,462.87 5,248.00 3,584.12 694.65 1 2 3 4 5 6 7 8 9 10 AIRX2RET MYD04_L2 MOD04_L2 TRMM_3B42 MOD14 AIRIBRAD MYD14 MOD021KM PODAAC 167 NSIDC-0032 AIRS/Aqua FINAL Level 2 Products (Without HSB) MODIS/Aqua Aerosol 5-Min L2 Swath 10km MODIS/Terra Aerosol 5-Min L2 Swath 10km TRMM 3B42 3-Hour 0.25deg x 0.25deg and Other-GPI Calibration Rainfall MODIS/Terra Thermal Anomalies/Fire 5-Min L2 Swath 1km AIRS/Aqua L1B infrared geolocated radiances MODIS/Aqua Thermal Anomalies/Fire 5-Min L2 Swath 1km MODIS/Terra Calibrated Radiances 5-Min L1B Swath 1km Jason-1 Operational Sensor Data Record (OSDR) DMSP SSM/I Pathfinder Daily EASE-Grid Brightness Temperatures L3 653.30 1,073.53 1,808.74 FY2009 Top 10 Products Distributed By # of Files Product Description Files 8,563,521 8,045,425 7,218,381 6,340,602 6,246,276 6,053,135 5,495,849 5,467,986 5,151,841 5,025,697 GBs 2,467.65 8,537.75 1,582.00 1,415.80 7,757.08 6,706.02 2,977.94 12.81 73,541.15 5,184.23 1 2 3 4 5 6 7 8 9 10 GNSS_DAILY_D TRMM_3B42 MOD14 MYD14 AIRX2RET MYD04_L2 GNSS_DAILY_O GNSS_IGSTROP MOD13Q1 MOD04_L2 GNSS Daily Compact Observation Data TRMM 3B42 3-Hour 0.25deg x 0.25deg and Other-GPI Calibration Rainfall MODIS/Terra Thermal Anomalies/Fire 5-Min L2 Swath 1km MODIS/Aqua Thermal Anomalies/Fire 5-Min L2 Swath 1km AIRS/Aqua FINAL Level 2 Products (Without HSB) MODIS/Aqua Level 2 Aerosol GNSS Daily Observation Data GNSS Final Troposphere Zenith Path Delay Product MODIS/Terra Level 3 16-Day Vegetation Indices - 250m MODIS/Terra Aerosol 5-MIN L2 Swath 10KM When counting # of files, metadata files are not included. March 2010 FY2009 Annual Report 28
Known U.S. - Foreign Product Distribution Trend Product Trend Foreign U.S. FY2007 35,960,845 65,563,006 FY2008 56,769,710 120,843,195 69,857,119 113,052,619 FY2009 * Does not include product distribution where the destination could not be determined March 2010 FY2009 Annual Report 29
Web Trends Web metrics data for EOSDIS became available as of FY2007, providing only one previous year to assess trends. Data for FY2007 is complete for 7 and FY2008 is complete for 8 of the 11 data centers providing metrics for FY2009. These web metrics are for visits of one minute or more. Views 7,599,722 8,263,283 11,463,765 Visits Visitors Repeat Visitors FY2007 FY2008 FY2009 707,365 827,714 1,079,317 443,079 523,416 702,058 77,731 91,801 116,886 March 2010 FY2009 Annual Report 30
Definitions (1 of 2) EMS Term Definition EOSDIS element serving as a source of metrics information for describing the ingest, archive and distribution of EOSDIS science data; web activity metrics are also collected. For the EOSDIS annual reporting, metrics from individual data providers at a single site are combined (e.g., NSIDC = NSIDCECS + NSIDCV0). Metrics describing the ingest, archive and distribution of EOSDIS science data at EOSDIS Data Centers. This EOSDIS Annual Report presents data metrics from EOSDIS Data Centers. Most metrics can be found in the EMS HTMLDB interface (http://ops1.ems.eosdis.nasa.gov: 8000/pls/apex/f?p=111). Metrics from other sources are noted in the report where applicable. Metrics describing the web activity at EOSDIS Data Center web sites and EOSDIS related web sites. This EOSDIS Annual Report presents web metrics by EOSDIS Data Centers. These metrics can be found in the EMS NetInsight interface (https://ems.eos.nasa.gov/NetInsight/index.html). Designates the type of business or organization accessing EOSDIS. The domain is determined from the IP address and country. Data Provider Data Metrics Web Metrics Domain EMS Data File Term Definition Ingest is the amount of data coming into a data center over a period of time and includes all product levels. Ingest Archive is the amount of data added to the archive over a period of time and includes all products levels. Archive The Total Archive Size describes the EOSDIS archive at the end of the fiscal year. This includes all data (including ancillary) but not data marked for deletion. Any individual requesting data as defined by an IP address plus email, within the time period. The number of distinct (i.e., counted once) users receiving data during the report period. The smallest unit of data inventoried and distributed to users; typically, a granule is a single data file, though some granules may include multiple files. EMS counts individual files as distinct products. This is roughly equivalent to counting EOS granules, although in the case of some EOS instrument data, a granule may contain more than one file. If so, the files are counted as individual products. The number of files successfully delivered to Public users. This count excludes METADATA file types. If the file type does not distinguish a file as a metadata or a science file, i.e., it is encoded as n/a, then the default process is to count the file as a science data product. Total Archive Size Data User Distinct Users Granule Product Number of Products Delivered Volume of Products Delivered The volume of data (in MBs) successfully delivered to Public users. This includes all file types, including METADATA. March 2010 FY2009 Annual Report 31
Definitions (2 of 2) EMS Data File Term Definition Any individual defined by an IP Address who requests and receives data for purposes other than product generation and quality assurance/testing. Any identified and authorized user who requests data for the purposes of quality assurance/testing. Any identified and authorized user who requests data for the purposes of product generation. All distinct Public users requesting data within the time period. Distinct Public users requesting data more than once during the time period. If the user is requesting data for the first time ever within the specific time period and then requests data again during the specific time period, he/she would be counted as a repeat user. Public User QA/Test User Production User All Users Repeat Users EMS Web File Term Definition Any individual defined by IP Address+browser that views a web page. A visitor can also become a 'Data User' once data is requested. The number of distinct (i.e., counted once) visitors to a provider's web sites during the time period. Hit by a user during a session to a web page, excluding error hits and hits to user-defined files such as inline images (.JPG, .GIF, etc.), Java applets, and specific redirects or services provided by the data provider. A series of consecutive views of a website by the same user without continuous interruption of more than 30 minutes. If a user does not view a new page in a specified time, the next page viewed by that user is considered the start of a new visit. The number of page views to a provider's web pages over the time period. The number of visits over the time period. All distinct visitors viewing a web page during the report time period. Visitors who view a web page during a specific time period who have accessed the system before. If the visitor accesses the system for the first time ever within the time period and then accesses the system again during the specific time period, he/she would be counted as a repeat visitor. Definition Metrics data directly from the EMS tools, presented by data provider as available. Visitor Distinct Visitors View Visit EMS Web Views EMS Web Visits All Visitors Repeat Visitors Report Term Stage 1 Stage 2 Metrics data grouped by data center , augmented with external data, includes all twelve data centers. Metrics data presented by the major contributing data centers, often accompanied by a graphic. Stage 3 March 2010 FY2009 Annual Report 32