Development of an assessment instrument to measure high school students' 21st century skills in social interaction

  • Magfirah Isnayah 
    Magister Pedagogi, Universitas Muhammadiyah Malang
    Indonesia
  • Daroe Iswatiningsih
    Indonesian Education Study Program, Universitas Muhammadiyah Malang
    Indonesia
  • Siti Inganah
    Mathematics Education Study Program, Universitas Muhammadiyah Malang
    Indonesia
  • Rafiah Mahmudah
    Biology Education Study Program, Universitas Muhammadiyah Makassar
    Indonesia

Abstract

This study aims to develop an assessment instrument to measure 21st-century skills—critical thinking, creativity, collaboration, and communication (4C)—in the context of social interaction learning for tenth-grade high school students. This research is grounded in the practical challenges faced by teachers, particularly the difficulty of assessing 4C competencies systematically due to the absence of standardized and context-specific assessment instruments in Sociology learning. In many schools, assessment practices still focus on cognitive outcomes, leaving social and interaction-based competencies underassessed. The study employed a Research and Development (R&D) approach using the Lee and Owens model, which includes five stages: analysis, design, development, implementation, and evaluation. Data were collected through teacher needs assessment questionnaires involving eight Sociology teachers, expert validation by three assessment specialists, and field trials with 45 students. Instrument validity was examined using Aiken’s V, while reliability was measured using Fleiss’ Kappa. Practicality was evaluated through questionnaires administered to teachers and students. The results indicate that the developed instrument demonstrates high content validity (Aiken’s V > 0.8), substantial to almost perfect inter-rater reliability, and high practicality, with teacher and student practicality scores of 100% and 80%, respectively. These findings suggest that the instrument is feasible and effective for classroom use. The developed assessment tool provides teachers with a practical means to evaluate students’ 4C skills in social interaction contexts, thereby supporting competency-based assessment practices in Sociology learning.

Keywords
  • Assessment Instrument
  • 21st-Century Skills
  • 4C
  • Social Interaction
  • Validity
  • Reliability
  • Lee & Owens
Lisensing Information
Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.

References
  1. Alamsyah, A., Raksanagara, A., & Desy, I. (2017). EMPATI DOKTER DI LAYANAN PRIMER: PENGUKURAN MENGGUNAKAN KUESIONERCONSULTATION AND RELATIONAL EMPATHY (CARE) VERSI INDONESIA. Majalah Kesehatan, 4, 69–78. https://doi.org/10.21776/ub.majalahkesehatan.2017.004.02.3
  2. Alvina, S. (2023). Pengembangan Instrumen Penilaian Keterampilan 4C (Critical Thinking, Collaboration, Communication, Creativity) Siswa Pada Materi Sifat Koligatif Larutan. Jurnal Genta Mulia, 14(2).
  3. Ambawono, G. P., Rahayuningsih, S., Iswatiningsih, D., Fardana, Y., & Khasanah, N. (2025). Building Students’ Social Emotional Character Phase A Through Project P5 Using Alternative Planting Media. Jurnal Pendidikan Dasar Nusantara, 10(2), 353-371https://ojs.unpkediri.ac.id/index.php/pgsd/. https://ojs.unpkediri.ac.id/index.php/pgsd/article/view/24530
  4. Amrianto, A., Rohman, F., Dharmawan, A., & Sari, S. (2024). Development of a 4C skills evaluation instrument for biology: A validity and reliability study on Indonesian high school students learning. International Journal of Innovative Research and Scientific Studies, 7. https://doi.org/10.53894/ijirss.v7i2.2873
  5. Anderson, L. W., & Krathwohl, D. R. (2001). A taxonomy for learning, teaching, and assessing: A revision of Bloom’s taxonomy of educational objectives: complete edition. Addison Wesley Longman, Inc.
  6. Bodin, Ö., Guerrero, A. M., Nohrstedt, D., Baird, J., Summers, R., Plummer, R., & Jasny, L. (2022). Choose your collaborators wisely: Addressing interdependent tasks through collaboration in responding to wildfire disasters. Public Administration Review, 82(6), 1154–1167.
  7. Churiyah, M., Rohmah, R. F. N., & Agustina, Y. (2021). 21st Century learning implementation: Authentic performance-based assessment of correspondence practicum. Sixth Padang International Conference on Economics Education, Economics, Business and Management, Accounting and Entrepreneurship (PICEEBA 2020), 283–287.
  8. Decuyper, A., Tack, H., Vanblaere, B., Simons, M., & Vanderlinde, R. (2023). Collaboration and shared responsibility in team teaching: a large-scale survey study. Education Sciences, 13(9), 896.
  9. Dewanti, B. A., & Santoso, A. (2020). Development of 21st century learning skills assessment instruments in STEM-Based Science Learning (Science, Technology, engineering, and mathematics). Prisma Sains: Jurnal Pengkajian Ilmu Dan Pembelajaran Matematika Dan IPA IKIP Mataram, 8(2), 99–111.
  10. Ekoati, E. S., Rakhman, F., & Zulaeha, I. (2021). The Necessity of The Indonesian Language Authentic Assessment Model Development Based on The Teacher Interview Results. 6th International Conference on Science, Education and Technology (ISET 2020), 94–98.
  11. Fitria, D., Lufri, L., Elizar, E., & Amran, A. (2023). 21st Century Skill-Based Learning (Teacher Problems In Applying 21st Century Skills). International Journal of Humanities Education and Social Sciences, 2(4), 1366–1373.
  12. Fook, C. Y., & Sidhu, G. K. (2010). Authentic assessment and pedagogical strategies in higher education. Journal of Social Sciences, 6(2), 153–161.
  13. Frey, B. B., & Schmitt, V. L. (2007). Coming to terms with classroom assessment. Journal of Advanced Academics, 18(3), 402–423.
  14. Greenstein, L. M. (2012). Assessing 21st century skills: A guide to evaluating mastery and authentic learning. Corwin Press.
  15. Hajaty, E. R., & Wati, I. R. L. (2020). Perilaku Sosial Ketetanggaan Dan Pengaruhnya Terhadap Penataan Ruang Luar Rumah Tinggal. Vitruvian Jurnal Arsitektur, Bangunan, & Lingkungan, 10(1), 69–78.
  16. Hinyard, L., Toomey, E., Eliot, K., & Breitbach, A. (2019). Student perceptions of collaboration skills in an interprofessional context: Development and initial validation of the self-assessed collaboration skills instrument. Evaluation & the Health Professions, 42(4), 450–472.
  17. Indarta, Y., Jalinus, N., Waskito, W., Samala, A. D., Riyanda, A. R., & Adi, N. H. (2022). Relevansi kurikulum merdeka belajar dengan model pembelajaran abad 21 dalam perkembangan era society 5.0. Edukatif: Jurnal Ilmu Pendidikan, 4(2), 3011–3024.
  18. Inganah, S., Darmayanti, R., & Rizqi, N. (2023). Problems, solutions, and expectations: 6C integration of 21st century education into learning mathematics. Solutions, and Expectations: 6C Integration of 21st Century Education into Learning Mathematics (March 06, 2023).
  19. Iswatiningsih, D., Pangesti, F., Puspitasari, L., & Dluhayati, D. (2022). Improving teachers’ skills on developing competence-based of e-student whorksheet. Journal of Community Service and Empowerment, 3(2), 103–114.
  20. Juliyantika, T., & Batubara, H. H. (2022). Tren Penelitian Keterampilan Berpikir Kritis pada Jurnal Pendidikan Dasar di Indonesia. Jurnal Basicedu, 6(3), 4731–4744.
  21. Junedi, B., Mahuda, I., & Kusuma, J. W. (2020). Optimalisasi keterampilan pembelajaran abad 21 dalam proses pembelajaran pada Guru MTs Massaratul Mut’allimin Banten. Transformasi: Jurnal Pengabdian Masyarakat, 16(1), 63–72.
  22. Kearney, S. (2013). Improving engagement: the use of ‘Authentic self-and peer-assessment for learning’to enhance the student learning experience. Assessment & Evaluation in Higher Education, 38(7), 875–891.
  23. Kelley, T. R., Knowles, J. G., Han, J., & Sung, E. (2019). Creating a 21st century skills survey instrument for high school students. American Journal of Educational Research, 7(8), 583–590.
  24. Kristanti, A. N., Ristiana, Y., & Iswatiningsih, D. (2025). PENGARUH ADIKSI GAME ONLINE TERHADAP PRESTASI AKADEMIK DAN INTERAKSI SOSIAL SISWA SEKOLAH DASAR. Pendas: Jurnal Ilmiah Pendidikan Dasar, 10(01), 941–953.
  25. Mattiro, S. (2022). Perilaku Imitasi Pada Youtuber: Studi Pada Siswa SMPN 3 Martapura, Kabupaten Banjar.
  26. Murcahyaningrum, S., Suyanto, E., & Widyastuti, T. R. (2023). Bentuk interaksi sosial masyarakat pendatang Bugis dengan masyarakat Sasak. Kaganga: Jurnal Pendidikan Sejarah Dan Riset Sosial Humaniora, 6(2), 373–386.
  27. Okpatrioka, O. (2023). Research and development (R&D) penelitian yang inovatif dalam pendidikan. Dharma Acariya Nusantara: Jurnal Pendidikan, Bahasa Dan Budaya, 1(1), 86–100.
  28. Oktavianti, A., & Arifin, Z. (2022). Transformasi Interaksi Sosial Sebagai Dampak Media Sosial Pada Siswa Sma Negeri 1 Petasia Morowali Utara. Jurnal Sosialisasi: Jurnal Hasil Pemikiran, Penelitian Dan Pengembangan Keilmuan Sosiologi Pendidikan, 1, 121. https://doi.org/10.26858/sosialisasi.v1i3.39167
  29. Pellerin, M. (2012). Digital documentation: Using digital technologies to promote language assessment for the 21st century. OLBI Journal, 4.
  30. Pujana, D. G. P. (2022). Private and Public English Teachers’ Readiness in Implementing 21st Century Skills at Primary Schools. International Journal of Language and Literature, 6(4), 149–157.
  31. Rizaldi, D. R., Nurhayati, E., & Fatimah, Z. (2020). The correlation of digital literation and STEM integration to improve indonesian students’ skills in 21st century. International Journal of Asian Education, 1(2), 73–80.
  32. Rudianto, R., Diani, R., Subandi, S., & Widiawati, N. (2022). Development of assessment instruments 4C skills (critical thinking, collaboration, communication, and creativity) on parabolic motion materials. Journal of Advanced Sciences and Mathematics Education, 2(2), 65–79.
  33. Saida, A., Ikram, M., Saida, A., & Ikram, M. (2021). Analysis of Students’ Creative Thinking in Solving Cuboid Problems Analysis of Students’ Creative Thinking in Solving Cuboid Problems. International Journal of Progressive Mathematics Education, 1(2), 104–116.
  34. Selvi Atesya Kesumawati, S. A. K., Bayu Hardiyono, B. H., Vinny Marselly, & Husni Fahritsani, H. F. (2022). The Development of V2 Playmat Game to Increase Movement Skill Children with Intellectual Disability (ID). Kinestetik : Jurnal Ilmiah Pendidikan Jasmani, 6(1 SE-Articles), 190–197. https://doi.org/10.33369/jk.v6i1.18185
  35. Setyaedhi, H. S. (2023). Gamification of 2d and 3d animation subjects to improve learning outcomes. Journal of Education Technology, 7(3), 532–542.
  36. Sugiyono, S. (2018). Quantitative and R&D Research Methods Bandung. CV Alfabeta Sugiyono.
  37. Sumarsono, P., Inganah, S., & Iswatiningsih, D. (2020). Belajar dan pembelajaran di Era Milenial (Vol. 1). UMMPress.
  38. Umami, M. (2018). Penilaian autentik pembelajaran pendidikan agama Islam dan budi pekerti dalam kurikulum 2013. Jurnal Kependidikan, 6(2), 222–232.
  39. Varghese, J. (2021). Why the optimism misses? an analysis on the gaps and lags of teachers’ perceptions of 21st century skills. Shanlax International Journal of Education.
  40. Wahyuni, M. (2018). Meta analisis assessmen formatif di pendidikan tinggi. Jurnal Cendikia: Jurnal Pendidikan Matematika, 2(1), 62–69.
  41. Waruwu, M. (2024). Metode penelitian dan pengembangan (R&D): konsep, jenis, tahapan dan kelebihan. Jurnal Ilmiah Profesi Pendidikan, 9(2), 1220–1230.
  42. Widayana, G. (2023). The influence of technical skills and 21st century skills on the job readiness of vocational students. IConVET 2022: Proceedings of the 5th International Conference on Vocational Education and Technology, IConVET 2022, 6 October 2022, Singaraja, Bali, Indonesia, 260.
  43. Yuniahans, P. D. W. G., Parlika, R., Arhinza, R. S., Majid, V. F., & Alifian, M. G. (2022). Uji validitas aplikasi si-book menggunakan SPSS dengan kombinasi metode r-tabel dan cohen’s kappa. Jurnal Teknologi Informasi: Jurnal Keilmuan Dan Aplikasi Bidang Teknik Informatika, 16(2), 121–133.
  44. Zorlu, Y., & Zorlu, F. (2021). Investigation of the Relationship between Preservice Science Teachers’ 21st Century Skills and Science Learning Self-Efficacy Beliefs with Structural Equation Model. Journal of Turkish Science Education, 18(1), 1–16.

Downloads

Pdf

Statistic

Abstract Views
: 74 times
Pdf
: 33 times