The Development of a Service-Learning Outcomes Measurement Scale (S-LOMS)
Keywords:Hong Kong, validation, scale development, exploratory factor analysis
Service-learning as a transformative pedagogy has been adopted within Hong Kong’s tertiary education sector for over a decade; however, the lack of a standardized and validated measurement instrument to assess its student learning outcomes has been an obstacle to its further development. The current research study, collaboratively conducted by Lingnan University, The Hong Kong Polytechnic University, Hong Kong Baptist University, and The Education University of Hong Kong, therefore aims to develop such a measurement instrument named the “Service-Learning Outcomes Measurement Scale (S-LOMS),” taking consideration of the unique features of service-learning in Hong Kong. The scale development and validation work, with exploratory factor analysis and reliability test, has thus far demonstrated that the student-perceived learning outcomes after service-learning can be measured and assessed through 56 items. These items cover 11 domains under four major categories, namely: a) knowledge application; b) personal and professional skills, including relationship and team skills, creative problem solving skills, self-reflection skills, and critical thinking skills, c) civic orientation and engagement, including sense of social responsibility, community commitment and understanding, and caring and respect, and d) self-awareness, including self-efficacy, self-understanding, and commitment to self-improvement. Several additional insights arising from the validation results are discussed.
Astin, A. W. & Sax, L. J. (1998). How undergraduates are affected by service participation. Journal of College Student Development, 39 (3), 251–263.
Astin, A., Vogelgesang, L., Ikeda, E., & Yee, J. (2000). How service-learning affects students. Los Angeles, CA: Higher Education Research Institute, UCLA.
Ash, S. L., Clayton, P. H. (2009). Generating, deepening, and documenting learning: The power of critical reflection for applied learning. Journal of Applied Learning in Higher Education, 1, 25–48.
Boyle-Baise, M. (2002). Multicultural service learning: Educating teachers in diverse communities. Teachers College Press, New York (2002).
Bonnette, R. (2006). Out of the classroom and into the community: Service learning reinforces classroom instruction. Technology Teacher 65(5), 6–11.
Bringle, R. G., & Hatcher, J. A. (1999). Reflection in service-learning: Making meaning of experience. Educational Horizons, 179–185.
Celio, C. I., Durlak, J., & Dymnicki, A. (2011). A meta-analysis of the impact of service-learning on students. Journal of Experiential Education, 34(2), 164–181. DOI: 10.5193/JEE34.2.164
Chan, A. C. M. (2011, June). Outcome measures for service-learning in Hong Kong. Paper presented at the 3rd Asia-Pacific Regional Conference on Service-Learning: Theory and Practice of Service-Learning: Cross-Cultural Service-Learning Programme in Asia-Pacific Region, Hong Kong.
Chan, S. C. F., & Ngai, G. (2014), Service-Learning as a core academic component in undergraduate programmes: A brief introduction to the Hong Kong Polytechnic University model. The Journal of Development Communication, 84–99.
Conway, J. M., Amel, E. L., & Gerwien, D. P. (2009). Teaching and learning in the social context: A meta-analysis of service learning's effects on academic, personal, social, and citizenship outcomes. Teaching of Psychology, 36(4), 233–245. DOI: 10.1080/00986280903172969
Driscoll, A., Holland, B., Gelmon, S., & Kerrigan, S. (1996). An assessment model for service-learning: Comprehensive case studies of impact on faculty, students, community and institutions. Michigan Journal of Community Service Learning, 3, 66–71.
Einfeld, A., & Collins, D. (2008). The relationships between service-learning, social justice, multicultural competence, and civic engagement. Journal of College Student Development, 49(2), 95–109. DOI: 10.1353/csd.2008.0017
Eyler, J. S., & Giles, D. E. (1999). Where's the learning in service learning? San Francisco: Jossey-Bass.
Eyler, J. S., Giles, D. E., Stenson, C. M., and Gray, C. J., (2001) At a glance: What we know about the effects of service-learning on college students, faculty, institutions and communities, 1993–2000. (3rd ed.) Nashville, Tenn.: Vanderbilt University Press.
Felten, P., & Clayton, P. H. (2011). Service-Learning. New Directions for Teaching and Learning, 128, 75–84. DOI: 10.1002/tl.470
Godfrey, P. C., Illes, L. M., & Berry, G. (2005). Creating breadth in business education through service-learning. Academy of Management Learning & Education 4(3), 309–323. DOI: 10.5465/amle.2005.18122420
Giles, D. E., & Eyler, J. (1994). The theoretical roots of service-learning in John Dewey: Toward a theory of service-learning. Michigan Journal of Community Service Learning, 1(1), 77–85.
Hatcher, J., Bringle, R., & Muthiah, R. (2004). Designing effective reflection: What matters to service- learning? Michigan Journal of Community Service Learning, 11(1), 38–46.
Jacoby, B. (1996). Service-Learning in higher education: concepts and practices. San Francisco: Jossey-Bass.
Keup, J. R. (2005). The impact of curricular interventions on intended second year re-enrollment. Journal of College Student Retention, 7(1-2), 61–89. DOI: 10.2190/2dcu-kaby-wvqh-2f8j
Lundy, B. L. (2007). Service learning in life-span developmental psychology: Higher exam scores and increased empathy. Teaching of Psychology, 34(1), 23–27. DOI: 10.1207/s15328023top3401_5
Ma, C. H. K., & Chan, A. C. M. (2013). A Hong Kong university first: Establishing service-learning as an academic credit-bearing subject. Gateways: International Journal of Community Research and Engagement, 6, 178–198. DOI: 10.5130/ijcre.v6i1.3286
Ma, H. K. C., Chan, C. W. F., Tse, P. H., & Chan, C. M. A. (2016). A common outcomes measurement for service-learning in Hong Kong. Unpublished manuscript.
O’Connor, B. P. (2000). SPSS and SAS programs for determining the number of components using parallel analysis and Velicer’s MAP test. Behavior Research Methods, Instruments, & Computers, 32(3), 396–402. DOI: 10.3758/bf03200807
Prentice, M. (2007). Service learning and civic engagement. Academic Questions, 20, 135–145. DOI: 10.1007/s12129-007-9005-y
Rama, D. V. (1998). Learning by doing: Concepts and models for service-learning in accounting. AAHE's series on service-learning in the disciplines. Washington, D.C.: American Association for Higher Education.
Richard, D., Keen, C., Hatcher, J. A., & Pease, H. A. (2017). Pathways to adult civic engagement: Benefits of reflection and dialogue across difference in higher education service-learning programs. Michigan Journal of Community Service Learning, 23(1), 60–74. DOI: 10.3998/mjcsloa.3239521.0023.105
Rosenberg, M. (1965). Society and the Adolescent Self Image, Princeton. NJ: Princeton University Press.
Ramsay, W. R. (2017). Service-Learning: Memories and perspectives. In Robert Shumer (Ed.) Where’s the Wisdom in Service-Learning? NC: Information Age Publishing.
Shek, D. & Chan, S. (2013) Service-learning from the views of university teachers: a qualitative study based on focus groups. International Journal of Adolescent Medicine and Health, 25(4), 385–393. DOI: 10.1515/ijamh-2013-0036
Shumer, R., Stanton, T. K. and Giles D. E., Jr. (2017), History and precursors of service-learning theory, development and research. In Robert Shumer (Ed.) Where’s the Wisdom in Service-Learning? NC: Information Age Publishing.
Simons, L., & Cleary, B. (2006). The influence of service learning on students’ personal and social development. College Teaching, 54(4), 307–319. DOI: 10.3200/ctch.54.4.307-319
Snell, R. S., Chan, M. Y. L., Ma, C. H. K., & Chan, C. K. M. (2015). Developing civic-mindedness in undergraduate business students through service-learning projects for civic engagement and service leadership practices for civic improvement. Asian Journal of Business Ethics, 4(1), 73–99. DOI: 10.1007/s13520-015-0044-0
Stevens, J. P. (2009). Applied Multivariate Statistics for the Social Sciences (5th ed.). New York: Routledge. DOI: 10.4324/9780203843130
Warren, J. L. (2012). Does service-learning increase student learning?: A meta-analysis. Michigan Journal of Community Service Learning, 18(2), 56–61.
Yorio, P. L., & Ye, F. (2012). A meta-analysis on the effects of service-learning on the social, personal, and cognitive outcomes of learning. Academy of Management Learning & Education, 11(1), 9–27. DOI: 10.5465/amle.2010.0072
Copyright to works published in Metropolitan Universities is retained by the author(s).