Evaluation of International Observe the Moon Night: Outcomes, Challenges, and Lessons Learned from Six Years of Data Collection

Abstract:

Evaluation of large public STEM events poses many challenges including data collection of moving crowds, representative sampling, and collecting sufficient data with available resources. International Observe the Moon Night (InOMN) is a yearly event held around the world on a single day coordinated by the Lunar Reconnaissance Orbiter with support from partners around the globe. Each year hundreds of events are held across the United States and in over 50 countries across the world. This distributed event poses even more challenges in its evaluation due to the fact that events vary widely in their implementation and that it is impossible for evaluators to collect data at any more than a small fraction of the events.

We present findings of six years of evaluation at InOMN events that implemented varying data collection techniques, incentives, and target outcomes as the event has evolved. Through analysis of these years of data, we have found that InOMN events are hosted by a variety of public and private institutions all over the world including museums, planetaria, schools, universities, observatories, parks, and private businesses and families, over half of which have hosted events for more than one year. Telescopes are present at a majority of the events and lunar science and exploration is often highlighted. Visitors who have been surveyed or interviewed often report being regular attendees at science related events but many were new to InOMN. Many of those surveyed report that they attended with friends and family making their participation a social event. Visitors also reported an increase in knowledge and excitement to learn more about the Moon as a result of their participation in an event. Overall, InOMN events have met both organizers and facilitators’ goals. We will discuss the different data collection techniques, challenges encountered and overcome, and lessons learned through this ongoing evaluation effort.