Improving Evaluation Plans Through Stakeholder Interviews
Stakeholder interviews are an effective, though often underutilized, method for developing a logic model. This paper details a semi-structured interview protocol that the reader can use to develop a logic model of their program services and outcomes. The interview protocol will walk evaluators through an extensive series of questions they should ask program stakeholders (e.g., funders, managers, staff, clients, etc). Moreover, the protocol is design to match certain questions to specific stakeholders. Therefore, reducing redundancy and maximizing comprehensiveness. These questions are designed to solicit information to identify (1) the inputs available for operating the program; (2) the planned activities and products that will be provided to program clients; (3) the size and scope of the activities or products delivered or produced by the program; (4) the anticipated short-term, intermediary, and long-term outcomes; and (5) the program theory that coherently binds each of these areas into a causal theory of change. Finally, the paper will provide an example of how this model was used to develop a model for a children’s mentoring program. With this interview protocol, even novice evaluators will be able to generate comprehensive logic models like seasoned professional evaluators.
Keywords: Evaluation, Logic model, Semi-structured interviews, Program theory
Mr. P. Cristian Gugiu
Doctoral Associate, Interdisciplinary Ph.D. in Evaluation, Western Michigan University
Faculty Member, Department of Educational Studies, Western Michigan University
Dr. Rodríguez has designed and delivered numerous workshops and courses at the university level in evaluation/metaevaluation, research, informatics, consulting, project planning, and control management. She has written a variety of publications in Spanish and in English on leadership, organizational engineering, and evaluation approaches that bring stakeholder groups together For example, she is the author of the book Collaborative Evaluations: A Step-by-Step Model for the Evaluator. In addition, she has presented her work in national and international conferences in countries such as Australia , Canada , China , England , Greece , India , Italy , Jamaica , Malaysia , Spain , the United States , and Venezuela .
Currently, Dr. Rodríguez is the Evaluation Faculty Member in the Evaluation, Measurement, and Research Program at WMU. She is a member of several professional associations such as Project Management Institute, American Evaluation Association, Michigan Association for Evaluation, and American Educational Research Association, among others. She serves as a co-chair of the Professional Development Committee and as a board member at the Michigan Association for Evaluation. She also serves on the board of directors at the Evaluation Capacity Development Group and as a co-chair of the Collaboration, Participatory, and Empowerment Evaluation Topical Interest Group at the American Evaluation Association. Dr. Rodríguez’s expertise with leadership, metaevaluation, multi-cultural and collaborative evaluation capacity building, project management, organizational engineering, and training are her strongest professional contributions.