An Overview of the Challenges with and Proposed Solutions for the Ingest and Distribution Processes For Airborne Data Management

Abstract:

The current data management practices for NASA airborne field projects have successfully served science team data needs over the past 30 years to achieve project science objectives, however, users have discovered a number of issues in terms of data reporting and format. The ICARTT format, a NASA standard since 2010, is currently the most popular among the airborne measurement community. Although easy for humans to use, the format standard is not sufficiently rigorous to be machine-readable, and there lacks a standard variable naming convention among the many airborne measurement variables. This makes data use and management tedious and resource intensive, and also create problems in Distributed Active Archive Center (DAAC) data ingest procedures and distribution. Further, most DAACs use metadata models that concentrate on satellite data observations, making them less prepared to deal with airborne data. There also exists a substantial amount of airborne data distributed by websites designed for science team use that are less friendly to users unfamiliar with operations of airborne field studies. A number of efforts are underway to help overcome the issues with airborne data discovery and distribution. The ICARTT Refresh Earth Science Data Systems Working Group (ESDSWG) was established to enable a platform for atmospheric science data providers, users, and data managers to collaborate on developing new criteria for the file format in an effort to enhance airborne data usability. In addition, the NASA Langley Research Center Atmospheric Science Data Center (ASDC) has developed the Toolsets for Airborne Data (TAD) to provide web-based tools and centralized access to airborne in situ measurements of atmospheric composition. This presentation will discuss the aforementioned challenges and attempted solutions in an effort to demonstrate how airborne data management can be improved to streamline data ingest and discoverability to a broader user community.