Opening the Conversation on REU Assessment and Evaluation

Abstract:

Project evaluation is a key component to ensuring success of any Research Experience for Undergraduates (REU) program. The Washington State University (WSU) Regional Atmospheric Chemistry: State-of-the-art Measurement and Modeling in the Pacific Northwest REU Site employs a mixed method approach to determine what is working well and what can use improvement (formative evaluation) and to determine impact and effectiveness of the project in reaching the stated goals (summative evaluation). Quantitative data is collected via a pre-/post-test measuring participants’ research self-efficacy (RSE), motivation, background information, extent of socialization, and their interpretation of the value of the REU experience. Qualitative data is gathered through individual interviews with the REU students (at the beginning and end of the program) and faculty mentors (at the end). Beginning interviews focus on expectations for the REU program and student backgrounds. End interviews focus on student RSE development, interpretations of their experience, and the value of the experience. Faculty mentors are interviewed to gather insight on student performance in the program and perspectives on the overall success of the program in meeting the proposed goals. Students are provided an opportunity to comment on the strengths and weaknesses of workshops, providing critical feedback to the particular instructor and enabling the faculty to modify the workshop content and activities in future years. Finally, research results are evaluated during the final poster presentation, and faculty are interviewed to report on their perception of how each student learned and gained knowledge during the program. To evaluate the retention of students in engineering and science and identify chosen career paths, a longitudinal survey was created and it is administered via email each year.

Many REU programs also employ the Undergraduate Research Students Self-Assessment (URSSA) online tool designed for evaluating REU experiences (University of Colorado at Boulder). Information presented in this presentation will include a discussion of the current tools used as described above as well as a discussion of the pros/cons of using URSSA. One of the concerns with using URSSA in conjunction with the other assessment tools is “survey fatigue”.