DOI:

Keywords:

Assessment tools, community, Engineers in Society, SULAM

Abstract

Service-Learning Malaysia-University for Society (SULAM) approach integrates theory and practice to expose students to real-world community problems and develop their higher-order thinking skills (HOTs). However, there is a lack of research on alternative assessment tools used to evaluate SULAM projects in engineering programs. This study focuses on the assessment tools used for the Engineers in Society (EIS) course integrated with SULAM (EiS-SULAM) and their effectiveness. A questionnaire survey was administered to 462 civil engineering students who took the EiS-SULAM course during the October 2020, March 2021, and October 2021 semesters. Of the 462 students, 165 responded to the questionnaire, resulting in a response rate of 36%. The students' perspectives were triangulated with the direct attainment of the program outcomes for the course based on the assessments used. The results showed that all students met the 50% cut-off mark for the EiS-SULAM course, satisfying the EAC Standard 2020 criterion. The study highlights that the four assessment tools used in the EIS course are effective, but there is a room for improvement. The students suggested the need for financial support from the university, improvements to the assessment tools, facilities such as internet, conducive environment to enhance their learning experience, and additional support from lecturers/advisors highlighting the importance of quality guidance and mentorship for student success. The study's findings could help improve engineering assessment instruments to enhance the students’ skill sets related to sustainable community. However, the use of purposive sampling may limit the generalizability of the results to other engineering programmes or institutions. The results suggest that the EIS-SULAM course is effective in developing students' HOTs and achieving essential skill sets for societal well-being. In conclusion, this study provides valuable insights into the effectiveness of assessment tools in SULAM projects for engineering programmes and its potential to develop the essential skill sets required for community and societal well-being. Future research could explore the effectiveness of SULAM in different engineering programmes and institutions using different sampling methods. In addition, promising avenue for future research is the integration of Artificial Intelligence (AI), such as ChatGPT, in the development of assessment prompts for engineering courses. This research could focus on creating AI-powered prompts aligned with course and program outcomes to enhance the efficiency and effectiveness of student evaluation.

References

Boon, J., Yap, H., Lip, Q., Hew, T., & Skitmore, M. (2022). Student Learning Experiences in Higher. Construction Economics and Building, 22(1), 1–20.

Chan, C. K. Y. (2020). Assessment for community service types of experiential learning in the engineering discipline. European Journal of Engineering Education, 1–12(March 2012). https://doi.org/10.1080/03043797.2011.644763

Engineering Accreditation Council. (2020). Engineering Programme Accreditation Standard 20207 (2020th ed.). Engineering Accreditation Department, Board of Engineers Malaysia.

Gadusova, Z., Fandelova, E., Viteckova, M., & Prochazka, M. (2017). Assessment Tools and Criteria- What To Apply To Teachers’ Work. Erie, December, 80–87.

Kiew, P. L., Liew, C. P., Puteh, M., & Tan, K. G. (2020). The impact of alternative assessments in assessing the seventh component of the Washington accord’s knowledge profile. Advances in Intelligent Systems and Computing, 1134 AISC, 707–718. https://doi.org/10.1007/978-3-030-40274-7_67

Libman, Z. (2010). Alternative assessment in higher education: An experience in descriptive statistics. Studies in Educational Evaluation, 36(1–2), 62–68. https://doi.org/10.1016/j.stueduc.2010.01.002

Mackenzie, S. L. C., Hinchey, D. M., & Cornforth, K. P. (2019). A public health service-learning capstone: Ideal for students, academia and community. Frontiers in Public Health, 7(10), 1–7. https://doi.org/10.3389/fpubh.2019.00010

Maharam Mamat, Najah Nadiah Amran, Hamdi Ishak, & Maznah Ibrahim. (2019). Service-Learning In Malaysia: Practice And Implementation In Four Public Universties. International Journal of Civil Engineering Technology, 10(4), 1682–1691.

Mat Isa, C. M., Chai Lian, O., & Chia Pao, L. (2022). Design of an Innovative Assessment Instrument Integrating Service-Learning Malaysia University for Society Approach for Engineers in Society Course during Covid19 Pandemic. Asean Journal of Engineering Education, 6(March), 58–68.

Ministry of Higher Education (MoHE). (2019). Service learning malaysia - university for society.

Mohamad Uri, N. F., & Abd Aziz, M. S. (2017). Alternative Assessment: Exploring the Effectiveness of Self-Assessment Practice among Engineering Students. Akademika, 87(01), 141–152. https://doi.org/10.17576/akad-2017-8701-10

Mohd-yusof, K., Helmi, S. A., Phang, F. A., & Mohammad, S. (2015). Future Directions in Engineering Education : Educating Engineers of the 21st Century. ASEAN Journal of Engineering Education, 2(1), 8– 13.

Muhammad, A., Lebar, O., & Mokshein, S. E. (2018). Rubrics as Assessment, Evaluation and Scoring Tools. International Journal of Academic Research in Business and Social Sciences, 8(10), 1417–1431. https://doi.org/10.6007/ijarbss/v8-i10/5309

Musa, N., Ibrahim, D. H. A., Abdullah, J., Saee, S., Ramli, F., Mat, A. R., & Khiri, M. J. A. (2017). A methodology for implementation of service learning in higher education institution: A case study from faculty of computer science and information technology, UNIMAS. Journal of Telecommunication, Electronic and Computer Engineering, 9(2–10), 101–109.

Mustaffa, Z., Muzzamil, S., & Shah, H. (2020). Impactful Alternative Assessment for a Civil Engineering Course during Pre- and Present COVID 19 Pandemic. Kuala Lumpur International Conference on Social Sciences, Education & Engineering (KLISEE2020), January 2021, 107–113.

Nikolic, S., Daniel, S., Haque, R., Belkina, M., Hassan, G. M., Grundy, S., Lyden, S., Neal, P., & Sandison, C. (2023). ChatGPT versus engineering education assessment: a multidisciplinary and multi-institutional benchmarking and analysis of this generative artificial intelligence tool to investigate assessment integrity. European Journal of Engineering Education, May. https://doi.org/10.1080/03043797.2023.2213169

Teacher Development and Certification. (2006). Effective Student Assessment and Evaluation in the Classroom. In Alberta Education.

Zebron, M. C. C. M. B. M. K. C. S. (2015). Challenges for open and distance learning (ODL) students: Experiences from students of the Zimbabwe Open University.