Abstract

Conclusion. This study concluded that PBWs effectively improved students’ conceptual understanding of logic gates in pneumatic. PBWs offered a more engaging and holistic learning experience. These findings highlight the need for consideration of student behaviour during testing to ensure accurate interpretation of educational outcomes.

Keywords: Conceptual understanding, problem-based learning, worksheet, Rasch analysis, vocational education

Abu Bakar, S. N., Mahmood, N., Ismail, A., Hashim, A., Hamsan, N. Y., Nor Hamid, N. I., & Che Yakzam, R. (2023). Validity and reliability of competency analysis instrument for cooperative board members using Rasch measurement model approach. International Journal of Academic Research in Business and Social Sciences, 13(6), 2408–2419. https://doi.org/10.6007/ijarbss/v13-i6/17543

Anselmi, P., Vidotto, G., Bettinardi, O., & Bertolotti, G. (2015). Measurement of change in health status with Rasch models. Health and Quality of Life Outcomes, 13(1), 1–7. https://doi.org/10.1186/s12955-014-0197-x

Aritia, E., & Suyanto, S. (2019). The effect of problem-based Learning model and concept map strategy for problem solving and understanding of the ecosystem concept of high school students. Journal of Physics: Conference Series, 1233(1). https://doi.org/10.1088/1742-6596/1233/1/012005

Boone, W. J., Yale, M. S., & Staver, J. R. (2014). Rasch analysis in the human sciences. In Rasch Analysis in the Human Sciences. https://doi.org/10.1007/978-94-007-6857-4

Bouchée, T., de Putter - Smits, L., Thurlings, M., & Pepin, B. (2022). Towards a better understanding of conceptual difficulties in introductory quantum physics courses. Studies in Science Education, 58(2), 183–202. https://doi.org/10.1080/03057267.2021.1963579

Çakıroğlu, Ü., Atabaş, S., Aydın, M., & Özyılmaz, I. (2022). Creating concept maps with augmented reality: A case of eclipse of the lunar and solar topic. Research and Practice in Technology Enhanced Learning, 17(1), 1–22. https://doi.org/10.1186/s41039-022-00191-1

Cano, F., García, Á., Justicia, F., & García, A. B. B. (2014). Learning approaches and reading comprehension: The role of student questioning and prior knowledge. Revista de Psicodidactica, 19(2), 247–266. https://doi.org/10.1387/RevPsicodidact.10186

Corlatescu, D., Watanabe, M., Ruseti, S., Dascalu, M., & McNamara, D. S. (2023). The automated model of comprehension version 3.0: Paying attention to context. Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 13916 LNAI, 229–241. https://doi.org/10.1007/978-3-031-36272-9_19

da Silva, J. G., Alvarenga, A. V., & Costa-Felix, R. P. . (2019). Evaluating the reliability and validity of a questionnaire used to collect data about the periodic evaluation of ultrasound therapy equipment. IFMBE Proceedings, 70(1), 825–828. https://doi.org/10.1007/978-981-13-2119-1

Dai, J. Y., Yeh, K. L., Kao, M. T., Yuan, Y. H., & Chang, M. W. (2021). Applying petri-net to construct knowledge graphs for adaptive learning diagnostics and learning recommendations. Journal of Research in Education Sciences, 66(3), 61–105. https://doi.org/10.6209/JORIES.202109_66(3).0003

Das, S., Nandgaonkar, V., Eklarker, R., Balkhande, B. W., & Pande, S. D. (2023). Exploring the dynamics of pbl-based learning: A study on collaboration, reflection, engagement, critical thinking, and student success. Design and Implementation of Higher Education Learners’ Learning Outcomes (HELLO), 146–158. https://doi.org/10.4018/978-1-6684-9472-1.ch009

Devika, S. V., Siddapuram, A., Kaur, R., & Kondala Rao, P. (2024). Enhancing program outcomes and academic performance throught problem-based learning in an antennas and wave propagation course. Journal of Engineering Education Transformations, 38(Special Issue 1), 140–145. https://doi.org/10.16920/jeet/2024/v38is1/24223

Dotimineli, A., & Mawardi, M. (2021). Development of STEM integrated PBL-based student worksheets in energetic materials of first-year students. Journal of Physics: Conference Series, 1788(1), 12045. https://doi.org/10.1088/1742-6596/1788/1/012045

Engelhard, G. (2013). Invariant measurement: Using rasch models in the social, behavioral, and health sciences. Invariant Measurement: Using Rasch Models in the Social, Behavioral, and Health Sciences, 1–288. https://doi.org/10.4324/9780203073636

Ferreira, M. L. P., Almeida, R. M. V. R., & Luiz, R. R. (2013). A new indicator for the measurement of change with ordinal scores. Quality of Life Research, 22(8), 1999–2003. https://doi.org/10.1007/s11136-012-0288-2

Fries, L., Son, J. Y., Givvin, K. B., & Stigler, J. W. (2021). Practicing connections: A framework to guide instructional design for developing understanding in complex domains. Educational Psychology Review, 33(2), 739–762. https://doi.org/10.1007/s10648-020-09561-x

Haruehansawasin, S., & Kiattikomol, P. (2018). Scaffolding in problem-based learning for low-achieving learners. Journal of Educational Research, 111(3), 363–370. https://doi.org/10.1080/00220671.2017.1287045

Hermundstad, A. L., Diller, T. E., Williams, C. B., & Matusovich, H. M. (2016). Exploring conceptual understanding in heat transfer: A qualitative analysis. ASEE Annual Conference and Exposition, Conference Proceedings. https://doi.org/10.18260/p.26845

Hmelo-Silver, C. E., & Barrows, H. S. (2008). Facilitating collaborative knowledge building. Cognition and Instruction, 26(1), 48–94. https://doi.org/10.1080/07370000701798495

Hope, D., Kluth, D., Homer, M., Dewar, A., Goddard-Fuller, R., Jaap, A., & Cameron, H. (2024). Exploring the use of Rasch modelling in “common content” items for multi-site and multi-year assessment. Advances in Health Sciences Education, 1–12. https://doi.org/10.1007/s10459-024-10354-y

Hung, W., & Amida, A. (2020). Problem-based learning in college science. Active Learning in College Science: The Case for Evidence-Based Practice, 325–339. https://doi.org/10.1007/978-3-030-33600-4

Jaganathan, S., Bhuminathan, S., Ramesh, M. (2024). Problem based learning - An overview. Journal of Pharmacy and Bioallied Sciences, 16(2). https://doi.org/10.4103/jpbs.JPBS

Jansen, B. J., Aldous, K. K., Salminen, J., Almerekhi, H., & Jung, S. gyo. (2024). A discussion of the validity of data analytics. Synthesis Lectures on Information Concepts, Retrieval, and Services, 139–145. https://doi.org/10.1007/978-3-031-41933-1_12

Küçük - Avcı, Ş., Akgün, Ö. E., & Balkan - Kıyıcı, F. (2024). Comparison of the effects of PBL in 3D virtual environment and F2F on learning and spatial skills. Education and Information Technologies, 29(17), 12686. https://doi.org/10.1007/s10639-024-12686-z

Kyriakopoulou, N., & Skopeliti, I. (2024). Rethinking Engagement: Insights from conceptual change research. Psychology, 29(2). https://doi.org/10.12681/psy

Laliyo, L. A. R., Sumintono, B., & Panigoro, C. (2022). Measuring changes in hydrolysis concept of students taught by inquiry model: Stacking and racking analysis techniques in Rasch model. Heliyon, 8(3), 9126. https://doi.org/10.1016/j.heliyon.2022.e09126

Lin, J. W., Yen, M. H., Liang, J. C., Chiu, M. H., & Guo, C. J. (2016). Examining the factors that influence students’ science learning processes and their learning outcomes: 30 years of conceptual change research. Eurasia Journal of Mathematics, Science and Technology Education, 12(9), 2617–2646. https://doi.org/10.12973/eurasia.2016.000600a

Linacre, J. M. (1994). Sample Size and Item Calibration or Person Measure Stability. Rasch Measurement Transactions, 7(4), 328. http://www.rasch.org/rmt/rmt74m.htm

Lu, J., Bridges, S., & Hmelo-Silver, C. E. (2014). Problem-based learning. In The Cambridge Handbook of the Learning Sciences, Second Edition. https://doi.org/10.1017/CBO9781139519526.019

Lu, S., & Bi, H. (2016). Development of a measurement instrument to assess students’ electrolyte conceptual understanding. Chemistry Education Research and Practice, 17(4), 1030–1040. https://doi.org/10.1039/c6rp00137h

Lugosi, E., & Uribe, G. (2022). Active learning strategies with positive effects on students’ achievements in undergraduate mathematics education. International Journal of Mathematical Education in Science and Technology, 53(2), 403–424. https://doi.org/10.1080/0020739X.2020.1773555

Maidan, Halim, A., Safitri, R., & Nurfadilla, E. (2020). Impact of Problem-based Learning (PBL) model through Science Technology Society (STS) approach on students’ interest. Journal of Physics: Conference Series, 1460(1), 12145. https://doi.org/10.1088/1742-6596/1460/1/012145

Marhaeni, N. H., & Andriyani. (2023). Students’ worksheet through problem based learning in determinant and inverse matrix material. AIP Conference Proceedings, 2733(1), 141780. https://doi.org/10.1063/5.0141780

Öz, E., Bulut, O., Cellat, Z. F., & Yürekli, H. (2024). Stacking: An ensemble learning approach to predict student performance in PISA 2022. Education and Information Technologies, 13110. https://doi.org/10.1007/s10639-024-13110-2

Pascual, G., & Goikoetxea, E. (2014). Comprehension of university texts: Effects of domain-knowledge and summary. Reading Psychology, 35(2), 101–126. https://doi.org/10.1080/02702711.2012.664612

Planinic, M., Boone, W. J., Susac, A., & Ivanjek, L. (2019). Rasch analysis in physics education research: Why measurement matters. Physical Review Physics Education Research, 15(2), 20111. https://doi.org/10.1103/PhysRevPhysEducRes.15.020111

Rahman, M. M., Adeniran, O., Shourabi, N. B., & Owolabi, O. (2022). Initial impact of evidence-based and experiment-focused teaching approach in a computer architecture course in computer science. Proceedings - 2022 International Conference on Computational Science and Computational Intelligence, 1996–2002. https://doi.org/10.1109/CSCI58124.2022.00359

Raja Subramanian, R., Venkatesh, K., Manikumar, T., Raja Sudharsan, R., & Aravindrajan, V. (2024). SHAPE: Design and evaluation of a transformative model for engineering education. Journal of Engineering Education Transformations, 38(Special Issue 1), 153–158. https://doi.org/10.16920/jeet/2024/v38is1/24225

Samsudin, A., Suhandi, A., Rusdiana, D., Kaniawati, I., Fratiwi, N. J., Zulfikar, A., Muhaemin, M. H., Hermita, N., Mansur, Wibowo, F. C., Supriyatman, Malik, A., & Costu, B. (2019). Optimizing students’ conceptual understanding on electricity and magnetism through cognitive conflict-based multimode teaching (CC-BMT). Journal of Physics: Conference Series, 1204(1), 12027. https://doi.org/10.1088/1742-6596/1204/1/012027

Sanusi, N., Zulkifli, H., & Hamzah, M. I. (2025). Challenges, opportunities, and effects of alternative assessment approaches in teaching practices: a systematic literature review. International Journal of Evaluation and Research in Education, 14(2), 1105–1113. https://doi.org/10.11591/ijere.v14i2.32283

Saravanakumar, D., Mohan, B., & Muthuramalingam, T. (2017). A review on recent research trends in servo pneumatic positioning systems. Precision Engineering, 49, 481–492. https://doi.org/10.1016/j.precisioneng.2017.01.014

Shana, Z. A., & El Shareef, M. A. (2022). Science teachers’ use of analogies: Findings from classroom practices. European Journal of Educational Research, 11(2), 1023–1036. https://doi.org/10.12973/EU-JER.11.2.1023

Shepherd, T., Trinder, M., & Theophilus, M. (2022). Does virtual reality in the perioperative setting for patient education improve understanding? A scoping review. Surgery in Practice and Science, 10. https://doi.org/10.1016/j.sipas.2022.100101

Sipayung, T. N. (2019). The development of mathematics’ worksheets based on problem solving at the numbers topics. Journal of Physics: Conference Series, 1211(1), 6–15. https://doi.org/10.1088/1742-6596/1211/1/012071

Soeharto, S., & Csapó, B. (2021). Evaluating item difficulty patterns for assessing student misconceptions in science across physics, chemistry, and biology concepts. Heliyon, 7(11), 8352. https://doi.org/10.1016/j.heliyon.2021.e08352

Sriatun, S., Ekohariadi, Sondang, M., Winanti, T., Ismayanti, E., & Nurlaela, L. (2020). Effectiveness in mathematics learning with the problem solving approach in vocational high school. Journal of Physics: Conference Series, 1511(1), 12116. https://doi.org/10.1088/1742-6596/1511/1/012116

Stolt, M., Kottorp, A., & Suhonen, R. (2022). The use and quality of reporting of Rasch analysis in nursing research: A methodological scoping review. International Journal of Nursing Studies, 132. https://doi.org/10.1016/j.ijnurstu.2022.104244

Syahmani, Suyono, & Imam Supardi, Z. A. (2020). Effectiveness of i-smart learning model using chemistry problems solving in senior high school to improve metacognitive skills and students’ conceptual understanding. Pedagogika, 138(2), 37–60. https://doi.org/10.15823/p.2020.138.3

Tavakol, M., O’Brien, D. G., Sharpe, C. C., & Stewart, C. (2024). Twelve tips to aid interpretation of post-assessment psychometric reports. Medical Teacher, 46(2), 188–195. https://doi.org/10.1080/0142159X.2023.2241624

Utami, W. P., Louise, I. S. Y., & Rampean, B. A. O. (2022). Analysis of teacher’s need through student’s worksheet development based on problem based learning on acid-base material. AIP Conference Proceedings, 2645, 113898. https://doi.org/10.1063/5.0113898

Van Grieken, R., Tena, J. D., Pires, L., Sanz, I., & AvendañoMiranda, L. L. (2024). The importance of test order in external and standardized test results: The case of PISA 2018. PLoS ONE, 19(9), 309980. https://doi.org/10.1371/journal.pone.0309980

Wallmark, J., Ramsay, J. O., Li, J., & Wiberg, M. (2023). Analyzing Polytomous Test Data: A Comparison Between an Information-Based IRT Model and the Generalized Partial Credit Model. Journal of Educational and Behavioral Statistics, 49(5), 753–779. https://doi.org/10.3102/10769986231207879

Wise, S. L. (2015). Effort Analysis: Individual Score Validation of Achievement Test Data. Applied Measurement in Education, 28(3), 237–252. https://doi.org/10.1080/08957347.2015.1042155

Yazbec, A., Borovsky, A., & Kaschak, M. P. (2019). Examining the impact of text style and epistemic beliefs on conceptual change. PLoS ONE, 14(9), 220766. https://doi.org/10.1371/journal.pone.0220766

Yeni, S., Grgurina, N., Saeli, M., Hermans, F., Tolboom, J., & Barendsen, E. (2024). Interdisciplinary integration of computational thinking in k-12 education: A systematic review. Informatics in Education, 23(1), 223–278. https://doi.org/10.15388/infedu.2024.08

Yerizon, Arnawa, I. M., Fitriani, N., & Tajudin, N. M. (2022). Constructing calculus concepts through worksheet based problem-based learning assisted by geogebra software. HighTech and Innovation Journal, 3(3), 282–296. https://doi.org/10.28991/HIJ-2022-03-03-04

Yıldırım, T., & Canpolat, N. (2019). An investigation of the effectiveness of the peer instruction method on teaching about solutions at the high-school level. Egitim ve Bilim, 44(199), 127–147. https://doi.org/10.15390/EB.2019.7966

Yusop, F. D., & Firdaus, A. (2022). Alternative assessments in malaysian higher education: Voices from the field., 1–309. https://doi.org/10.1007/978-981-16-7228-6

Zhang, Q. (2011). The application of multiple linear regress equation on analysing the effect factors of student scores. 2011 International Conference on Multimedia Technology, ICMT 2011, 6087–6089. https://doi.org/10.1109/ICMT.2011.06002588