Navigating the Tensions of Community Engagement Evaluation through Culturally Responsive and Equity-Oriented Approaches
DOI:
https://doi.org/10.18060/28044Abstract
For decades, community-campus partnerships have helped transform traditional notions of research. Through approaches such as community-based participatory research (CBPR), decolonizing methodologies, and participatory action research (PAR), community and academic partners have expanded the confines of expertise, centering local, experiential, Indigenous, and professional knowledge in research (Fine & Torre, 2021; Minkler & Wallerstein, 2011; Stanton, 2014). Voices in our field have challenged narrow conceptualizations of who is a “researcher” (Blodgett et al., 2011; Ishimaru & Bang, 2022), redefined concepts like validity to account for the process and impact of research-in-action (Anderson & Herr, 1999; Torre et al., 2012), critiqued racist and colonial practices embedded in traditional research approaches (Chilisa, 2019; Darroch & Giles, 2014), and expanded what research products look like beyond the narrow confines of academic publishing (Chen et al., 2010).
References
Anderson, G. L., & Herr, K., (1999). The new paradigm wars: Is there room for rigorous practitioner knowledge in schools and universities? Educational Researcher, 28(5), 12–40. https://doi.org/10.3102/0013189X028005012
American Evaluation Association. (n.d.). What is evaluation? https://www.eval.org/About/What-is-Evaluation.
Bamberger, M., & Segone, M. (2011). How to design and manage equity-focused evaluations. UNICEF Evaluation Office. https://agora.unicef.org/course/info.php?id=1238
Blodgett, A. T., Schinke, R. J., Smith, B., Peltier, D., & Pheasant, C. (2011). In Indigenous words: Exploring vignettes as a narrative strategy for presenting the research voices of Aboriginal community members. Qualitative inquiry, 17(6), 522–533. https://doi.org/10.1177/1077800411409885
Cantwell, B., & Kauppinen, I. (Eds.). (2014). Academic capitalism in the age of globalization. JHU Press.
CCPH Board of Directors. (2013). Position Statement on Authentic Partnerships. Community-Campus Partnerships for Health. https://ccphealth.org/partnering/principles-of-partnering/
Centers for Disease Control. (2011). Principles of community engagement (Second Edition). National institutes of Health. https://www.atsdr.cdc.gov/communityengagement/pdf/PCE_Report_508_FINAL.pdf
Centers for Disease Control. (2013). Building our understanding: Key concepts of evaluation: What is it and how do you do it? https://www.atsdr.cdc.gov/communityengagement/pdf/PCE_Report_508_FINAL.pdf
Chen, P. G., Diaz, N., Lucas, G., & Rosenthal, M. S. (2010). Dissemination of results in community-based participatory research. American Journal of Preventive Medicine, 39(4), 372–378. https://doi.org/10.1016/j.amepre.2010.05.021
Chilisa, B. (2019). Indigenous research methodologies. Sage publications.
Conley-Tyler, M. (2005). A fundamental choice: Internal or external evaluation? Evaluation Journal of Australasia, 4(1-2), 3–11. https://doi.org/10.1177/1035719X05004001-202
Darroch, F., & Giles, A. (2014). Decolonizing health research: Community-based participatory research and postcolonial feminist theory. The Canadian Journal of Action Research, 15(3), 22–36. https://doi.org/10.33524/cjar.v15i3.155
Denzin, N. K. (2009). The elephant in the living room: Or extending the conversation about the politics of evidence. Qualitative research, 9(2), 139–160. https://doi.org/10.1177/1468794108098034
Dostilio, L. D. (Ed.). (2017). The community engagement professional in higher education: A competency model for an emerging field. Campus Compact.
Expanding the Bench® Team and Advisory Team (2019). History and definition of culturally responsive and equitable evaluation. Change Matrix. https://expandingthebench.org/cree-definition
Fine, M., & Torre, M. E. (2021). Essentials of critical participatory action research. American Psychological Association.
Ghanbarpour, S., Noguez Mercado, A. P., & Palotai, A. (2020). A language justice framework for culturally responsive and equitable evaluation. New Directions for Evaluation, 2020(166), 37–47. https://doi.org/10.1002/ev.20412
Giancola, S. P. (2020). Program evaluation: Embedding evaluation into program design and development. Sage Publications.
Gomez, B. J., Greenberg, M. T., & Feinberg, M. E. (2005). Sustainability of community coalitions: An evaluation of communities that care. Prevention Science, 6, 199–202. https://doi.org/10.1007/s11121-005-0003-4
Greene, J. C., & McClintock, C. (1991). The evolution of evaluation methodology. Theory into practice, 30(1), 13–21. https://www.jstor.org/stable/1476552
Harrison, S. (2021). Fundamental principles of CREE in all phases of evaluation (CREE Learning Series). Expanding the Bench.
Hoekstra, F., Mrklas, K.J., Khan, M., McKay, R. C., Vis-Dunbar, M., Sibley, K. M., Nguyen, T., Graham, I. D., SCI Guiding Principles Consensus Panel, & Gainforth, H. L. (2020). A review of reviews on principles, strategies, outcomes and impacts of research partnerships approaches: a first step in synthesising the research partnership literature. Health Research Policy and Systems 18(51). https://doi.org/10.1186/s12961-020-0544-9
Ishimaru, A. M., & Bang, M. (2022). Designing with families for just futures. Journal of Family Diversity in Education, 4(2), 130-140.
Israel BA, Lachance L, Coombe CM, Lee SD, Jensen M, Wilson-Powers E, Mentz G, Muhammad M, Rowe Z, Reyes AG, Brush BL. Measurement Approaches to Partnership Success: Theory and Methods for Measuring Success in Long-Standing Community-Based Participatory Research Partnerships. Progress in Community Health Partnerships.,14(1):129–140.
Israel, B. A., Lachance, L., Coombe, C. M., Lee, S. Y. D., Jensen, M., Wilson-Powers, E., Mentz, G., Muhammad, M., Rowe, Z., Reyes, A. G., & Brush, B. L. (2020). Measurement approaches to partnership success: Theory and methods for measuring success in long-standing CBPR partnerships. Progress in community health partnerships: research, education, and action, 14(1), 129. https://doi.org/10.1353/cpr.2020.0015
James, J. H., & Logan, K. (2016). Documenting the community impact of service-learning coursework: Theoretical and practical considerations. Partnerships: A Journal of Service-Learning and Civic Engagement, 7(2), 17-36.
Kuttner, P. J., Rawlings, L., & Washington, M. (2023). Toward a research and practice agenda for evaluation in community-campus partnerships. Metropolitan Universities, 43(3). https://doi.org/10.18060/26786
Lowery, D., May, D. L., Duchane, K. A., Coulter-Kern, R., Bryant, D., Morris, P. V., & Bellner, M. (2006). A logic model of service-learning: Tensions and issues for further consideration. Michigan Journal of Community Service Learning, 12(2), 47–6. http://hdl.handle.net/2027/spo.3239521.0012.205
Minkler, M., & Wallerstein, N. (Eds.). (2011). Community-based participatory research for health: From process to outcomes. John Wiley & Sons.
Mrklas, K.J., Boyd, J.M., Shergill, S. et al. (2023). Tools for assessing health research partnership outcomes and impacts: a systematic review. Health Research Policy and Systems 21, (3). https://doi.org/10.1186/s12961-022-00937-9
Mrklas, K.J., Merali, S., Khan, M. et al.(2022). How are health research partnerships assessed? A systematic review of outcomes, impacts, terminology and the use of theories, models and frameworks. Health Research Policy and Systems 20(133). https://doi.org/10.1186/s12961-022-00938-8
Muller, J. (2018). The tyranny of metrics. Princeton University Press.
Ortiz K, Nash J, Shea L, Oetzel J, Garoutte J, Sanchez-Youngman S, Wallerstein N. (2020). Partnerships, processes, and outcomes: A health equity-focused scoping meta-review of community-engaged scholarship. Annual Review of Public Health, 41, 177–199. Doi: 10.1146/annurev-publhealth-040119-094220.
Patton, M. Q. (1997). Utilization-focused Evaluation (3rd ed.). Sage.
Peacock, D., Andrée, P., Levkoe, C. Z., Goemans, M., Changfoot, N., & Kim, I. (2020). Accounting for community impact: Thinking across the spaces and times of a seven-year pan-Canadian community-based research project. Michigan Journal of Community Service Learning, 26(1), 175–196.
Phipps, D., Pepler, D., Craig, W., Cummings, J., & Cardinal, S. (2016). The co-produced pathway to impact describes knowledge mobilization processes. Journal of Community Engagement and Scholarship, 9(1), 31–40. https://doi.org/10.54656/GOKH9495
Raftery, J., Hanley, S., Greenhalgh, T., Glover, M., & Blotch-Jones, A. (2016). Models and applications for measuring the impact of health research: update of a systematic review for the Health Technology Assessment programme. Health technology assessment, 20(76). https://doi.org/10.3310/hta20760
Rogers, P. J. (2008). Using programme theory to evaluate complicated and complex aspects of interventions. Evaluation, 14(1), 29–48. https://doi.org/10.1177/135638900708467
Sandoval, J. A., Lucero, J., Oetzel, J., Avila, M., Belone, L., Mau, M., Pearson, C., Tafoya, G. , Duran, B., Rios, L. I., & Wallerstein, N. (2012). Process and outcome constructs for evaluating community-based participatory research projects: a matrix of existing measures. Health Education Research, 27(4), 680–690.
Seifer, S. D. (2000). Community-campus partnerships for health: An overview. Metropolitan Universities, 11(2), 7-9.
Stanton, C. R. (2014). Crossing methodological borders: Decolonizing community-based participatory research. Qualitative Inquiry, 20(5), 573-583.
Stickl Haugen, J., & Chouinard, J. A. (2019). Transparent, Translucent, Opaque: Exploring the Dimensions of Power in Culturally Responsive Evaluation Contexts. American Journal of Evaluation, 40(3), 376-394. https://doi.org/10.1177/1098214018796342
Torre, M. E., Fine, M., Stoudt, B. G., & Fox, M. (2012). Critical participatory action research as public science. In H. Cooper, P. M. Camic, D. L. Long, A. T. Panter, D. Rindskopf, & K. J. Sher (Eds.), APA handbook of research methods in psychology, Vol. 2. Research designs: Quantitative, qualitative, neuropsychological, and biological (pp. 171–184). American Psychological Association. https://doi.org/10.1037/13620-011
Waetzig, E., & Villalobos, A. (2023). Culturally responsive and equitable evaluation: Learning through a community-led approach. Expanding the Bench. https://static1.squarespace.com/static/62c7350a095f6d3e168029f0/t/6491b8ba9904a1426c2e884d/1687271617639/ETB+AFN+Presentation+Final.pdf
Wallerstein, N., & Duran, B. (2017). The theoretical, historical and practice roots of CBPR. In M. Minkler & N. Wallerstein, (Eds.), Community based participatory research for health (pp. 25–46). Jossey Bass. http://dx.doi.org/10.13140/RG.2.2.34282.72648
Wallerstein N, Oetzel JG, Sanchez-Youngman S, Boursaw B, Dickson E, Kastelic S, Koegel P, Lucero JE, Magarati M, Ortiz K, Parker M, Peña J, Richmond A, & Duran B. (2020). Engage for Equity: A Long-Term Study of Community-Based Participatory Research and Community-Engaged Research Practices and Outcomes. Health Education and Behavior, 47(3), 380–390. https://doi.org/10.1177/1090198119897075
Wallerstein, N., Belone, L., Burgess, E., Dickson, E., Gibbs, L., Chanchien Parajón, L., Ramgard, M., Sheikhattari, P., & Silver, G. (2021). Community based participatory research: Embracing praxis for transformation. The SAGE handbook of participatory research, 2, 663-679.
Downloads
Published
Issue
Section
License
Copyright (c) 2024 Paul Kuttner
This work is licensed under a Creative Commons Attribution 4.0 International License.
