Cover Page

Pedagogy of Evaluation

Michael Quinn Patton


New Directions for Evaluation

Sponsored by the American Evaluation Association


Paul R. Brandon
University of Hawai‘i at Mānoa


J. Bradley Cousins
University of Ottawa
Lois-ellin Datta
Datta Analysis


Anna Ah Sam
University of Hawai‘i at Mānoa
Michael Bamberger
Independent consultant
Gail Barrington
Barrington Research Group, Inc.
Fred Carden
International Development Research Centre
Thomas Chapel
Centers for Disease Control and Prevention
Leslie Cooksy
Sierra Health Foundation
Fiona Cram
Katoa Ltd.
Peter Dahler-Larsen
University of Southern Denmark
E. Jane Davidson
Real Evaluation Ltd.
Stewart Donaldson
Claremont Graduate University
Jody Fitzpatrick
University of Colorado Denver
Deborah M. Fournier
Boston University
Jennifer Greene
University of Illinois at Urbana-Champaign
Melvin Hall
Northern Arizona University
George M. Harrison
University of Hawai‘i at Mānoa
Gary Henry
Vanderbilt University
Rodney Hopson
George Mason University
George Julnes
University of Baltimore
Jean King
University of Minnesota
Saville Kushner
University of Auckland
Robert Lahey
REL Solutions Inc.
Miri Levin-Rozalis
Ben Gurion University of the Negev and Davidson Institute at the Weizmann Institute of Science
Laura Leviton
Robert Wood Johnson Foundation
Melvin Mark
Pennsylvania State University
Sandra Mathison
University of British Columbia
Robin Lin Miller
Michigan State University
Michael Morris
University of New Haven
Debra Rog
Westat and the Rockville Institute
Patricia Rogers
Royal Melbourne Institute of Technology
Mary Ann Scheirer
Scheirer Consulting
Robert Schwarz
University of Toronto
Lyn Shulha
Queen's University
Nick L. Smith
Syracuse University
Sanjeev Sridharan
University of Toronto
Monica Stitt-Bergh
University of Hawai‘i at Mānoa

Editorial Policy and Procedures

New Directions for Evaluation, a quarterly sourcebook, is an official publication of the American Evaluation Association. The journal publishes works on all aspects of evaluation, with an emphasis on presenting timely and thoughtful reflections on leading-edge issues of evaluation theory, practice, methods, the profession, and the organizational, cultural, and societal context within which evaluation occurs. Each issue of the journal is devoted to a single topic, with contributions solicited, organized, reviewed, and edited by one or more guest editors.

The editor-in-chief is seeking proposals for journal issues from around the globe about topics new to the journal (although topics discussed in the past can be revisited). A diversity of perspectives and creative bridges between evaluation and other disciplines, as well as chapters reporting original empirical research on evaluation, are encouraged. A wide range of topics and substantive domains are appropriate for publication, including evaluative endeavors other than program evaluation; however, the proposed topic must be of interest to a broad evaluation audience.

Journal issues may take any of several forms. Typically they are presented as a series of related chapters, but they might also be presented as a debate; an account, with critique and commentary, of an exemplary evaluation; a feature-length article followed by brief critical commentaries; or perhaps another form proposed by guest editors.

Submitted proposals must follow the format found via the Association's website at Proposals are sent to members of the journal's Editorial Advisory Board and to relevant substantive experts for single-blind peer review. The process may result in acceptance, a recommendation to revise and resubmit, or rejection. The journal does not consider or publish unsolicited single manuscripts.

Before submitting proposals, all parties are asked to contact the editor-in-chief, who is committed to working constructively with potential guest editors to help them develop acceptable proposals. For additional information about the journal, see the “Statement of the Editor-in-Chief” in the Spring 2013 issue (No. 137).




Paul R. Brandon, Editor-in-Chief
University of Hawai‘i at Mānoa
College of Education
1776 University Avenue
Castle Memorial Hall, Rm. 118
Honolulu, HI 968222463

Statement of the Co Editors-in-Chief

This issue marks the transition of the Editor-in-Chief (EIC) role from Paul Brandon to the new Co-Editors, Leslie Fierro and Todd Franke. Readers who have taken advantage of the content of New Directions for Evaluation (NDE) in previous years will know that Paul has served as an exceptional EIC. We are deeply honored that AEA has entrusted us with this important role, and it is our hope that we can continue to uphold the standards Paul employed during his tenure and to dedicate ourselves as fully as he has to producing issues that are informative to our field. Over the past seven months, Paul has patiently mentored us through the processes involved in the EIC role, without his coaching we would be entering a great unknown, instead we feel as well prepared as one possibly can for such a journey.

In addition to Paul's tutelage, we will be well supported by our 24-member Editorial Board some of whom are continuing their tenure as Board members and others who are joining anew. We selected our Editorial Board with the intention of including voices from across our discipline—from individuals who reside in academia instructing students, conducting research on evaluation, and practicing evaluation to others who have full-time roles as internal or external evaluators within independent consulting or large commercial firms, foundations, and the government, building evaluation capacity and conducting evaluations. Collectively with our Editorial Board we have experienced evaluation across a broad range of substantive areas including but not limited to—medicine, public health, education, public administration, social work, and environment. It is our expectation that this diversity of lenses will help facilitate the publication of NDE issues that will contribute to the growth of our field.

We have a passion for promoting, sustaining, and actively engaging in collaborative processes to build the field of evaluation and feel that NDE plays an incredibly important role in this process. With this in mind, we have several focal points as the incoming co-EICs. First, we encourage potential guest editors to develop proposals that embrace, highlight, and aim to find creative solutions to the challenges we experience as evaluation practitioners. It is important to us, and we believe the field more generally, that we find better ways to connect research, theory, and practice, and it is our hope that some of the NDE issues published during our tenure will aim to thoughtfully connect these three domains. Second, evaluation is conducted in contexts that reflect a dynamic interplay of systems ranging from the individual to societal which can interlock well or be out of alignment at any point in time. We live in a time that seems to have become increasingly complex, divisive, and in some ways unstable, indicating a potential imbalance in these systems. Proposals for issues that highlight how evaluation can meaningfully contribute to promoting the advancement of society, social betterment, and addressing the issues of our time are strongly encouraged. Third, the field of evaluation has a slight tendency toward being insular. In reviewing the existing literature in our field, we often find that we cite each other and do not always draw upon relevant and substantial bodies of work that exist in other disciplines. Future directions for our field may come from conversations, thought experiments, and research that integrates perspectives and bodies of scholarship from evaluation and beyond (e.g., cognitive psychology, business administration, public policy, arts and humanities). Finally, we will adopt one of the aims that Paul Brandon put forth in 2013, reporting on high-quality research on evaluation. Building upon our previous point, such research may come from within the field of evaluation itself, but it may also come from collaborations between evaluation scholars and those outside of our discipline, or from other disciplines altogether.

We look forward to working with the Editorial Board and guest editors to continue producing insightful issues that push our field forward, as well as seeing all of you at AEA this November in Washington, DC. For those of you considering topics for potential issues, please do not hesitate to reach out to us. We will be hosting several sessions via webinars and in-person at upcoming conferences describing the process for submitting to the journal and general manuscript preparation. For additional information on the process for submitting full proposals, please visit:



Leslie A. Fierro, Ph.D., MPH

Assistant Clinical Professor of Evaluation

Claremont Graduate University

Division of Organizational and Behavioral Sciences



Todd Michael Franke, Ph.D., MSW



Department of Social Welfare