Evaluating an EPO Program in an NSF Facility: Successes and Challenges of Developing Robust Evaluation with Modest Resources

Abstract:

Many science and technology facilities, as well as science-focused non-profits have directorates or divisions dedicated to education, outreach, and often communications. These Education and Outreach programs typically have complex portfolios of projects and sub-programs ranging from communications and general outreach to professional training and development of key stakeholders. UNAVCO’s Education and Community Engagement (ECE) Program provides outreach, education and communications services to the NSF geodetic facility. Specific areas of focus for ECE include: professional development and training, educational materials development and dissemination, community communications, and a geo-workforce development sub-program. Activities within these four areas are determined through a combination of strategic planning and resource availability. Since 2013, the ECE program has worked toward developing a robust planning and evaluation process.

Annual strategic planning sessions identify the scope of work for the coming year. An annual implementation plan is developed from these sessions including specific tasks, targets and performance metrics. Quarterly review of progress and realignment of work guides the program and a formal internal evaluation of annual work progress informs the following year’s scope of work. The UNAVCO ECE program has consulted with external evaluators on this process and has incorporated suggestions to improve the process after the first year. This presentation will provide an overview of the implementation plan and evaluation process. We will share with the community the successes and challenges of developing a robust evaluation plan that incorporates all program portfolio elements.