Improving Evaluation Plans Through Stakeholder Interviews

Mr. P. Cristian Gugiu,
Liliana Rodríguez-Campos
To add a paper, Login.

Stakeholder interviews are an effective, though often underutilized, method for developing a logic model. This paper details a semi-structured interview protocol that the reader can use to develop a logic model of their program services and outcomes. The interview protocol will walk evaluators through an extensive series of questions they should ask program stakeholders (e.g., funders, managers, staff, clients, etc). Moreover, the protocol is design to match certain questions to specific stakeholders. Therefore, reducing redundancy and maximizing comprehensiveness. These questions are designed to solicit information to identify (1) the inputs available for operating the program; (2) the planned activities and products that will be provided to program clients; (3) the size and scope of the activities or products delivered or produced by the program; (4) the anticipated short-term, intermediary, and long-term outcomes; and (5) the program theory that coherently binds each of these areas into a causal theory of change. Finally, the paper will provide an example of how this model was used to develop a model for a children’s mentoring program. With this interview protocol, even novice evaluators will be able to generate comprehensive logic models like seasoned professional evaluators.

Keywords: Evaluation, Logic model, Semi-structured interviews, Program theory
Stream: Research Methodologies, Quantitative and Qualitative Methods
Presentation Type: Virtual Presentation in English
Paper: A paper has not yet been submitted.

Mr. P. Cristian Gugiu

Doctoral Associate, Interdisciplinary Ph.D. in Evaluation, Western Michigan University
Kalamazoo, Michigan, USA

Mr. P. Cristian Gugiu has a master’s degree in Child Clinical and Community Psychology and over ten years of combined research and evaluation experience. Currently, Mr. Gugiu is a doctoral student in the Interdisciplinary PhD in Evaluation program at Western Michigan University. In his capacity as a doctoral student, Mr. Gugiu has developed a novel evaluation methodology that permits evaluators to determine the degree of confidence one can place on their evaluative conclusions; managed a metaevaluation of five educational evaluations; developed a comprehensive evaluation-planning guide; and developed, administered and analysed a national evaluation certification exam. Before returning to graduate studies, Mr. Gugiu worked as a program evaluator at James Bell Associates. During that time, he served as a Research Associate for numerous national evaluations, including: (a) Technical Assistance on Evaluation to Adoption Opportunities and Child Abuse and Neglect Grantees, (b) Performance of States in achieving the Child Welfare Outcome Measures, (c) HIV/AIDS Treatment Adherence, Health Outcomes, and Cost Study and (d) National Evaluation of the Regional Primate Research Centers. Due to these rich and diverse experiences, Mr. Gugiu is an expert in evaluation theory and evaluation specific methodologies, evaluation project management, qualitative and quantitative analysis and measurement theory and practice.

Liliana Rodríguez-Campos

Faculty Member, Department of Educational Studies, Western Michigan University

Dr. Liliana Rodríguez-Campos earned her Ph.D. in Educational Leadership with a concentration in Evaluation, Measurement, and Research Design at Western Michigan University (WMU). She received an Outstanding Dissertation Award, and a WMU Provost’s Special Recognition for this Ph.D. Also, as part of her educational background, she earned her Bachelor's in Systems Engineering with Honorific Mention, and her Specialist and Master's degrees in Project Management in Engineering with Summa Cum Laude Honors. Furthermore, she received a WMU President's Special Recognition for her second Master's degree in Educational Leadership with a concentration in Evaluation, Measurement, and Research Design. Dr. Rodríguez has been awarded with several honors and educational scholarships both in Venezuela and the United States . She has been a planning and control manager, and a consultant in the private sector, non-profit organizations as well as institutions of higher education. Dr. Rodríguez's work history includes the formative evaluation of multi-national corporations and evaluation capacity-building projects in Latin America, the Philippines , and the United States .

Dr. Rodríguez has designed and delivered numerous workshops and courses at the university level in evaluation/metaevaluation, research, informatics, consulting, project planning, and control management. She has written a variety of publications in Spanish and in English on leadership, organizational engineering, and evaluation approaches that bring stakeholder groups together For example, she is the author of the book Collaborative Evaluations: A Step-by-Step Model for the Evaluator. In addition, she has presented her work in national and international conferences in countries such as Australia , Canada , China , England , Greece , India , Italy , Jamaica , Malaysia , Spain , the United States , and Venezuela .

Currently, Dr. Rodríguez is the Evaluation Faculty Member in the Evaluation, Measurement, and Research Program at WMU. She is a member of several professional associations such as Project Management Institute, American Evaluation Association, Michigan Association for Evaluation, and American Educational Research Association, among others. She serves as a co-chair of the Professional Development Committee and as a board member at the Michigan Association for Evaluation. She also serves on the board of directors at the Evaluation Capacity Development Group and as a co-chair of the Collaboration, Participatory, and Empowerment Evaluation Topical Interest Group at the American Evaluation Association. Dr. Rodríguez’s expertise with leadership, metaevaluation, multi-cultural and collaborative evaluation capacity building, project management, organizational engineering, and training are her strongest professional contributions.

Ref: I06P0457