NASA's EOSDIS Approach to Big Earth Data Challenges

Abstract:

Over the past 20 years, NASA has been committed to making our Earth Science data more useable and accessible, not only to the community of NASA science researchers, but also to the world-wide public research community. The data collected by NASA’s remote sensing instruments represent a significant public investment in research. NASA holds these data in a public trust to promote comprehensive, long-term Earth science research. The Earth Observing System Data & Information System (EOSDIS) was established to meet this goal. From the beginning, NASA employed a free, open and non-discriminatory data policy to maximize the global utilization of the products derived from NASA’s observational data and related analyses. EOSDIS is designed to ingest, process, archive, and distribute data in a multi-mission environment. The system supports a wide variety of Earth science disciplines, including cryosphere, land cover change, radiation budget, atmosphere dynamics and composition, as well as inter-disciplinary research, including global climate change.  A distributed architecture was adopted to ensure discipline-specific support for the science data, while also leveraging standards and establishing policies and tools to enable interdisciplinary research, and analysis across multiple instruments. Over the past 2 decades the EOSDIS has evolved substantially. Today’s EOSDIS is a tightly coupled, yet heterogeneous system designed to meet the requirements of a diverse user community. The system was scaled to expand to meet the ever-growing volume of data (currently ~10 petabytes), and the exponential increase in user demand that has occurred over the past 15 years. We will present how the EOSDIS has evolved to support the variety and volume of NASA’s Earth Science data.