This article presents the results of a survey conducted in an attempt to examine evaluators’ perceptions of the contributions that different educational experiences make to the development of their evaluation skill sets. Self-identified new and graduate student evaluators were asked to describe their evaluation training experiences and to indicate how important each experience was to the development of particular evaluation competencies. A paired-comparison analysis was conducted to determine the scaling of the contribution each educational experience made to the development of each competency. Results show that the perceived contribution of different training experiences changes depending on which evaluation competency is being developed. Pedagogical implications of these findings are also discussed.
AltschuldJ. W. (1999). The case for a voluntary system for credentialing evaluators. American Journal of Evaluation, 20, 507–517.
3.
AltschuldJ. W.EngleM.CullenC.KimI.MacceB. R. (1994). The 1994 directory of evaluation training programs. New Directions for Program Evaluation, 62, 71–94.
4.
American Evaluation Association, Task Force on Guiding Principles for Evaluators. (1995). Guiding principles for evaluators. New Directions for Program Evaluation, 66, 19–26.
5.
ChristieC. A.RoseM. (2003). Learning about evaluation through dialogue: Lessons from an informal discussion group. American Journal of Evaluation, 24, 235–243.
6.
DavisB. G. (1986). Overview of the teaching of evaluation across the disciplines. New Directions for Program Evaluation, 29, 5–14.
7.
DeweyJ. D.MontrosseB. E.SchroterD. C.SullinsC. D.MattoxJ. R. (2008). Evaluator competencies: What’s taught versus what’s sought. American Journal of Evaluation, 29, 268–287.
8.
EdwardsA. L. (1957). Techniques of attitude scale construction. New York, NY: Appleton-Century-Crofts.
9.
EngleM.AltschuldJ. W.KimY. (2006). 2002 Survey of evaluation preparation programs in universities: An update of the 1992 American evaluation association-sponsored study. American Journal of Evaluation, 27, 353–359.
10.
FitzpatrickJ. (1994). Alternative models for the structuring of professional preparation programs. New Directions for Program Evaluation, 62, 41–50.
11.
GhereG.KingJ. A.StevahnL.MinnemaJ. (2006). A professional development unit for reflecting on program evaluator competencies. American Journal of Evaluation, 27, 108–123.
12.
GredlerM. E.JohnsonR. L. (2001). Lessons learned from the directed evaluation experience. American Journal of Evaluation, 22, 97–104.
13.
GreenS. G.BauerT. A. (1995). Supervisory mentoring by advisers: Relationships with doctoral student potential, productivity and commitment. Personnel Psychology, 48, 537–562.
14.
LaVelleJ. M.DonaldsonS. I. (2010). University-based evaluation training programs in the United States 1980–2008: An empirical examination. American Journal of Evaluation, 31, 9–23.
15.
Levin-RozalisM.RosensteinB. (2003). A mentoring approach to the one-year evaluation course. American Journal of Evaluation, 24, 245–259.
16.
MarkM. M. (2008). Building a better evidence base for evaluation theory: Beyond general calls to a framework of types of research on evaluation. In SmithN. L.BrandonP. (Eds.), Fundamental issues in evaluation (pp. 111–134). New York, NY: Guilford Press.
17.
MertensD. M. (1994). Training evaluators: Unique skills and knowledge. New Directions for Program Evaluation, 62, 17–27.
18.
MillerR. L. (2010) Developing standards for empirical examinations of evaluation theory. American Journal of Evaluation, 31, 390–399.
NolinskeT. (1995). Multiple mentoring relationships facilitate learning during fieldwork. The American Journal of Occupational Therapy, 49, 39–43.
21.
Office of Program Consultation and Accreditation Education Directorate, American Psychological Association. (2007). Guidelines and principles for accreditation of programs in professional psychology. Retrieved fromwww.apa.org/ed/accreditation/about/policies/guiding-principles.pdf
22.
SchwandtT. A. (2008). Educating for intelligent belief in evaluation. American Journal of Evaluation, 29, 140–151.
23.
SmithN. L. (1993). Improving evaluation theory through the empirical study of evaluation practice. Evaluation Practice, 14, 237–242.
24.
StevahnL.KingJ. A.GhereG.MinnemaJ. (2005). Establishing essential competencies for program evaluators. American Journal of Evaluation, 26, 43–59.
25.
StufflebeamD. L. (2001). Interdisciplinary Ph.D. programming in evaluation. American Journal of Evaluation, 22, 445–455.
26.
YarbroughD. B.ShulhaL. M.HopsonR. K.CaruthersF. A. (2011). The program evaluation standards: A guide for evaluators and evaluation users (3rd ed.). Thousand Oaks, CA: Sage.
