Increasingly, government, foundations, and others are asking community-based organizations for more evaluation information. Although the demand for this information may be increasing, the field knows very little about the way organizations are responding to this demand. Using data collected from interviews and a mail survey of community-based organizations, this article addresses five research questions: (a) What types of activities do community-based organizations use to evaluate their programs? (b) What types of data do they collect? (c) How do they collect data? (d) Who has the primary responsibility for conducting evaluation? and (e) Where does the funding come from? The answers to these questions are intended to serve as the basis for future discussions about building evaluation capacity and improving community-based services.
Bamberger, M., Rugh, J., Church, M., & Fort, L. (2004). Shoestring evaluation: Designing impact evaluations under budget, time and data constraints. American Journal of Evaluation, 25(1), 5-37.
2.
Boulmetis, J., & Dutwin, P. (2005). The ABCs of evaluation: Timeless techniques for program and project managers (2nd ed.). San Francisco: Jossey-Bass.
3.
Botcheva, L., White, C. R., & Huffman, L. C. (2002). Learning culture and outcomes measurement practices in community agencies. American Journal of Evaluation, 23(4), 421-434.
4.
Braverman, M. T., Constantine, N. A., & Slater, J. K. (Eds.). (2004). Foundations and evaluation: Contexts and practices for effective philanthropy. San Francisco: Jossey-Bass.
5.
Carman, J. G., & Millesen, J. L. (2005). Nonprofit program evaluation: Organizational challenges and resource needs. Journal of Volunteer Administration, 23(3), 36-43.
6.
Cutt, J., & Murray, V. (2000). Accountability and effectiveness evaluation in non-profit organizations. New York: Routledge.
7.
Ebrahim, A. (2005). Accountability myopia: Losing sight of organizational learning. Nonprofit and Voluntary Sector Quarterly, 34(1), 56-87.
8.
Fetterman, D. M., Kaftarian, S. J., & Wandersman, A. (Eds.). (1996). Empowerment evaluation: Knowledge and tools for self-assessment and accountability. Thousand Oaks, CA: Sage.
9.
Fine, A. H., Thayer, C. E., & Coghlan, A. (1998). Program evaluation practice in the nonprofit sector. Washington, DC: Innovation Network.
10.
Glaser, M. A., Soskin, M. D., & Smith, M. (1996). Local government-supported community development: Community priorities and issues of autonomy. Urban Affairs Review, 31(6), 778-798.
11.
Goldenkoff, R. (2004). Using focus groups. In J. S. Wholey, H. P. Hatry & K. E. Newcomer (Eds.), Handbook of practical program evaluation (2nd ed., pp. 340-362). San Francisco: Jossey-Bass.
12.
Gormley, W. T. (2004). Using organizational report cards. In J. S. Wholey, H. P. Hatry, & K. E. Newcomer (Eds.), Handbook of practical program evaluation (2nd ed., pp. 628-648). San Francisco: Jossey-Bass.
13.
Gray, S. T., & Associates (Eds.). (1998). Evaluation with power: Developing organizational effectiveness, empowerment and excellence. San Francisco: Jossey-Bass.
14.
Gronbjerg, K. A. (1993). Understanding nonprofit funding. San Francisco: Jossey-Bass.
15.
Hatry, H. P. (1999). Performance measurement: Getting results. Washington, DC: Urban Institute Press.
16.
Hatry, H. P. (2004). Using agency records. In J. S. Wholey, H. P. Hatry, & K. E. Newcomer (Eds.), Handbook of practical program evaluation (2nd ed., pp. 396-411). San Francisco: Jossey-Bass.
17.
Hendricks, M. (2000, February). Outcomes measurement in the nonprofit sector: Recent developments, incentives, and challenges. Paper presented at the meeting of the American Society for Public Administration, Washington, DC.
18.
Henry, G. T., & Mark, M. M. (2003). Toward an agenda for research on evaluation. In C. A. Christie (Ed.), The practice-theory relationship in evaluation: New directions for evaluation (Vol. 97, pp. 69-80). San Francisco: Jossey-Bass.
19.
Herman, R. D., & Associates (2005). The Jossey-Bass handbook of nonprofit leadership and management (2nd ed.). San Francisco: Jossey-Bass.
20.
Hoefer, R. (2000). Accountability in action? Program evaluation in nonprofit human service agencies. Nonprofit Management and Leadership, 11(2), 167-177.
21.
Hudson, M. (2005). Managing at the leading edge: New challenges in managing community-based organizations. San Francisco: Jossey-Bass.
22.
King, J. (2003). The challenge of studying evaluation. In C. A. Christie (Ed.), The practice-theory relationship in evaluation (New Directions for Evaluation, Vol. 97, pp. 57-68). San Francisco: Jossey-Bass.
23.
Kopczynski, M. E., & Pritchard, K. (2004). The use of evaluation by nonprofit organizations. In J. S. Wholey, H. P. Hatry, & K. E. Newcomer (Eds.), Handbook of practical program evaluation (2nd ed., pp. 649-669). San Francisco: Jossey-Bass.
24.
McLaughlin, J. A., & Jordan, G. B. (2004). Using logic models. In J. S. Wholey, H. P. Hatry, & K. E. Newcomer (Eds.), Handbook of practical program evaluation (2nd ed., pp. 7-32). San Francisco: Jossey-Bass.
25.
Morley, E., Vinson, E., & Hatry, H. P. (2001). Outcome measurement in nonprofit organizations: Current practices and recommendations. Waldorf, MD: Independent Sector.
26.
Mullen, E. J., & Magnabosco, J. L. (Eds.). (1997). Outcomes measurement in the human services: Cross-cutting issues and methods. Washington, DC: National Association of Social Workers.
27.
Murray, V. (2005). Evaluating the effectiveness of nonprofit organizations. In R. D. Herman & Associates (Eds.), The Jossey-Bass handbook of nonprofit leadership and management (2nd ed., pp. 345-370). San Francisco: Jossey-Bass.
28.
National Congress for Community and Economic Development. (1995). Tying it all together: The comprehensive achievements of community based development corporations. Washington, DC: Author.
29.
Newcomer, K. E. (2004). How might we strengthen evaluation capacity to manage evaluation contracts. American Journal of Evaluation, 25(2), 209-218.
30.
Newcomer, K. E., Hatry, H. H., & Wholey, J. S. (2004). Meeting the need for practical evaluation approaches: An introduction. In J. S. Wholey, H. P. Hatry, & K. E. Newcomer (Eds.), Handbook of practical program evaluation (2nd ed., pp. xxxiii-xliv). San Francisco: Jossey-Bass.
31.
O’Sullivan, R. G. (2004). Practicing evaluation: A collaborative approach. Thousand Oaks, CA: Sage.
32.
Palley, H. A., & Van Hollen, V. (2000). Long term care for people with developmental disabilities: A critical analysis. Health and Social Work, 25(3), 181-189.
33.
Plantz, M. C., Greenway, M. T., & Hendricks, M. (1997). Outcome measurement: Showing results in the nonprofit sector. In K. E. Newcomer (Ed.), Using performance measurement to improve public and nonprofit programs (New Directions for Evaluation, No. 75. pp. 15-30). San Francisco: Jossey-Bass.
34.
Poister, T. H. (2004). Performance monitoring. In J. S. Wholey, H. P. Hatry, & K. E. Newcomer (Eds.), Handbook of practical program evaluation (2nd ed., pp. 98-125). San Francisco, CA: Jossey-Bass.
35.
Rossi, P. H., & Freeman, H. E. (1993). Evaluation: A systemic approach (5th ed.). Newbury Park, CA: Sage.
36.
Saidel, J. R. (1994). The dynamics of interdependence between public agencies and nonprofit organizations. Research in Public Administration, 3, 201-229.
37.
Sanders, J. R. (2003). Mainstreaming evaluation. In J. J. Barnette & J. R. Sanders (Eds.), The mainstreaming of evaluation (New Directions for Evaluation, Vol. 99, pp. 3-6). San Francisco: Jossey-Bass.
38.
Smith, Bucklin, & Associates, Inc. (2000). The complete guide to nonprofit management (2nd ed.). New York: John Wiley.
39.
Smith, S. R. (2002). Social services. In L. M. Salamon (Ed.), The state of nonprofit America (pp. 149-186). Washington, DC: Brookings Institution Press.
40.
Smith, S. R., & Lipsky, M. (1993). Nonprofits for hire: The welfare state in the age of contracting. Cambridge, MA: Harvard University Press.
41.
Stoecker, R. (1997). The CDC model of urban redevelopment: A critique and an alternative. Journal of Urban Affairs, 19(1), 1-22.
42.
Straussman, J. D. (1990). Public administration. White Plains, NY: Longman.
43.
Stufflebeam, D. L. (2002, July). Institutionalizing evaluation checklist. Retrieved October 26, 2006, from http://www.wmich.edu/evalctr/checklists/institutionalizingeval.pdf
44.
Theodoulou, S. Z. (1995). Making public policy. In S. Z. Theodoulou & M. A. Cahn (Eds.), Public policy: The essential readings (pp. 89-96). Englewood Cliffs, NJ: Prentice Hall.
45.
Vidal, A. C. (1992). Rebuilding communities: A national study of community development corporations. New York: Community Development Research Center, New School for Social Research.
46.
Vidal, A. C. (2002). Housing and community development. In L. M. Salamon (Ed.), The state of nonprofit America (pp. 219-239). Washington, DC: Brookings Institution Press.
47.
Volkov, B. B., & King, J. A. (2005, October). A grounded checklist for implementing evaluation capacity building in organizations. Paper presented at the Joint Meeting of the American Evaluation Association and Canadian Evaluation Society, Toronto, Ontario, Canada.
48.
W. K. Kellogg Foundation. (n.d.). Evaluation handbook. Collateral Management Company, 1255 Hill Brady Road, Battle Creek, MI 49015, Item Number 1203.
49.
Waltz, M. (1999). Pervasive developmental disorders: Finding a diagnosis and getting help. Sebastopol, CA: O’Reilly & Associates.
50.
Weiner, S. J., Kirsch, A. D., & McCormack, M. T. (2002). Balancing the scales: Measuring the roles and contributions of nonprofit organizations and religious congregations. Washington, DC: Independent Sector.
51.
Weiss, C. H., Murphy-Graham, E., & Birkeland, S. (2005). An alternate route to policy influence: How evaluations affect D.A.R.E. American Journal of Evaluation, 26(1), 12-30.
