Volume 11 Issue 2 (2022)

Did Home-Based Exams during COVID-19 Affect Student Ranking? A Case from a Business School

pp. 96-113  |  Published Online: June 2022  |  DOI: 10.22521/edupij.2022.112.5

Leiv Opstad, Ivar Pettersen

Abstract

Background/purpose – Home-based exams were introduced during COVID-19 with an open-book format and limited control over dishonest student behavior. Such exams were used in lieu of traditional, closed-book school-based exams as a necessity due to the pandemic. This article investigates whether or not students’ grades from home-based assessment exams differed from the grades they achieved in traditional school-based exams.

Materials/methods – Using administrative data from 2017 to 2020 from a business school in Norway, a quantitative approach that compared differences, correlation analysis, and regression models was applied in the study.

Results – By switching from school-based to home-based exams, students’ academic success during their second year of business school showed a smaller association with students’ outcomes from their first year. One interpretation is that skilled students achieved weaker performance in home-based exams.

Conclusion – Home-based exams without any control mechanisms appear to result in different student rankings. This knowledge may be useful for employers looking to hire applicants who graduated during the COVID-19 pandemic.

Keywords: COVID-19, home-based exam, business students, students’ performance

References

Abdelrahim, Y. (2021). How COVID-19 quarantine influenced online exam cheating: A case of Bangladesh university students. Journal of Southwest Jiaotong University, 56(1), 137-146. https://www.jsju.org/index.php/journal/article/view/808

Akulwar-Tajane, I., Raikundlia, H., Gohil, R., & Shinde, S. (2021). Academic stress in physiotherapy students: Are open book examinations the solution in the face of COVID-19 pandemic? Health Research, 5(2), 1-28. http://www.itspoa.com/itsadmin/Ll/LL.DE.asp?action=Paper_Information&id=2174&at=Academic%20Stress%20in%20Physiotherapy%20Students:%20Are%20Open%20Book%20Examinations%20the%20Solution%20in%20the%20Face%20of%20COVID-19%20Pandemic?&jn=Health%20Research

Allen, J., & Robbins, S. B. (2008). Prediction of college major persistence based on vocational interests, academic preparation, and first-year academic performance. Research in Higher Education, 49(1), 62-79. https://doi.org/10.1007/s11162-007-9064-5

Arnold, I. J. (2016). Cheating at online formative tests: Does it pay off? The Internet and Higher Education, 29, 98-106. https://doi.org/10.1016/j.iheduc.2016.02.001

Bawarith, R., Basuhail, A., Fattouh, A., & Gamalel-Din, S. (2017). E-exam cheating detection system. International Journal of Advanced Computer Science and Applications, 8(4), 176-181. https://dx.doi.org/10.14569/IJACSA.2017.080425

Bengtsson, L. (2019). Take-home exams in higher education: A systematic review. Education Sciences, 9(4), Article 267. https://doi.org/10.3390/educsci9040267

Bilen, E., & Matros, A. (2021). Online cheating amid COVID-19. Journal of Economic Behavior & Organization, 182, 196-211. https://doi.org/10.1016/j.jebo.2020.12.004

Brookhart, S. M., Guskey, T. R., Bowers, A. J., McMillan, J. H., Smith, J. K., Smith, L. F., & Welsh, M. E. (2016). A century of grading research: Meaning and value in the most common educational measure. Review of Educational Research, 86(4), 803-848. https://doi.org/10.3102/0034654316672069

Cluskey, G. R., Jr., Ehlen, C. R., & Raiborn, M. H. (2011). Thwarting online exam cheating without proctor supervision. Journal of Academic and Business Ethics, 4(1). https://www.aabri.com/manuscripts/11775.pdf

Dave, M., Dixon, C., & Patel, N. (2021). An educational evaluation of learner experiences in dentistry open-book examinations. British Dental Journal, 231(4), 243-248. https://doi.org/10.1038/s41415-021-3258-7

Dodeen, H. M. (2012). Undergraduate student cheating in exams. Damascus University Journal, 28(1), 37-55.

Eurboonyanun, C., Wittayapairoch, J., Aphinives, P., Petrusa, E., Gee, D. W., & Phitayakorn, R. (2021). Adaptation to open-book online examination during the COVID-19 pandemic. Journal of Surgical Education, 78(3), 737-739. https://doi.org/10.1016/j.jsurg.2020.08.046

Guangul, F. M., Heijne‐Penninga, M., Kuks, J. B., Hofman, W. A., & Cohen‐Schotanus, J. (2008). Influence of open‐and closed‐book tests on medical students’ learning approaches. Medical Education, 42(10), 967-974. https://doi.org/10.1111/j.1365-2923.2008.03125.x

Guo, H. (2021). How Did Students Engage with a Remote Educational Assessment? A Case Study. Educational Measurement: Issues and Practice. Advance online publication. https://doi.org/10.1111/emip.12476

Hickson, S., Reed, W. R., & Sander, N. (2012). Estimating the effect on grades of using multiple-choice versus constructive-response questions: Data from the classroom. Educational Assessment, 17(4), 200-213. https://doi.org/10.1080/10627197.2012.735915

Johanns, B., Dinkens, A., & Moore, J. (2017). A systematic review comparing open-book and closed-book examinations: Evaluating effects on development of critical thinking skills. Nurse Education in Practice, 27, 89-94. https://doi.org/10.1016/j.nepr.2017.08.018

Karakose, T. (2021). Emergency remote teaching due to COVID-19 pandemic and potential risks for socioeconomically disadvantaged students in higher education. Educational Process: International Journal, 10(3), 53-62. https://dx.doi.org/10.22521/edupij.2021.103.4

Kedem-Yemini, S., & Katz, A. (2021). Implementing online-testing–cases in higher education in Israel. Journal of Information Technology Case and Application Research, 23(2), 83-114. https://doi.org/10.1080/15228053.2021.1882742

King, D. L., & Case, C. J. (2014). E-cheating: Incidence and trends among college students. Issues in Information Systems, 15(1), 20-27. https://doi.org/10.48009/1_iis_2014_20-27

Kjølseth, J. I. (2021, July 8). Studenter innrømmer juks på eksamen. Universitetsavisa. NTNU. https://www.universitetsavisa.no/nyheter-student/studenter-innrommer-juks-pa-eksamen/109154

Klein, H. A., Levenburg, N. M., McKendall, M., & Mothersell, W. (2007). Cheating during the college years: How do business school students compare? Journal of Business Ethics, 72(2), 197-206. https://doi.org/10.1007/s10551-006-9165-7

König, C., & Frey, A. (2022). The Impact of COVID‐19‐Related School Closures on Student Achievement—A Meta‐Analysis. Educational Measurement: Issues and Practice, 41(1), 16-22. https://doi.org/10.1111/emip.12495

Krathwohl, D. R. (2002). A revision of Bloom’s taxonomy: An overview. Theory into Practice, 41(4), 212-218. https://doi.org/10.1207/s15430421tip4104_2

Lin, C.-H. S., & Wen, L.-Y. M. (2007). Academic dishonesty in higher education—A nationwide study in Taiwan. Higher Education, 54(1), 85-97. https://doi.org/10.1007/s10734-006-9047-z

Mikkelsen, S. (2021, June 18). Studenter utveksler svar under eksamen. Universitetsavisa. NTNU. https://www.universitetsavisa.no/student/studenter-utvekslet-svar-under-eksamen/109592

Mikkelsen, S. (2022, January 22). Faglærer sjekket markedet for juks på nett. Ble tilbudt en god besvarelse for 500 kroner. Universitetsavisa. NTNU. https://www.universitetsavisa.no/andrey-chesnokov-eksamen-eksamensjuks/faglaerer-sjekket-markedet-for-juks-pa-nett-ble-tilbudt-en-god-besvarelse-for-500-kroner/206094

Namoun, A., & Alshanqiti, A. (2021). Predicting student performance using data mining and learning analytics techniques: a systematic literature review. Applied Sciences, 11(1), Article 237. https://doi.org/10.3390/app11010237

Norges Teknisk-Naturvitenskapelige Universitet. (2021). Rapport fra «Digital undervisning ved NTNU Handelshøyskolen. Notat NTNU.

Oguntunde, P. E., Okagbue, H. I., Oguntunde, O. A., Opanuga, A. A., & Oluwatunde, S. J. (2018). Analysis of the inter-relationship between students’ first year results and their final graduating grades. International Journal of Advanced and Applied Sciences, 5(10), 1-6. https://doi.org/10.21833/ijaas.2018.10.001

Opstad, L. (2018) Success in business studies and mathematical background: the case of Norway. Journal of Applied Research in Higher Education, 10(3), 399-408. https://doi.org/0.1016/S1477-3880(15)30059-1

Opstad, L. (2021). Performance and differences in grading practices among undergraduates at business schools. International Journal of Assessment Tools in Education, 8(4), 785-800. https://doi.org/10.21449/ijate.902699

Opstad, L., & Årethun, T. (2020a). Factors that explain undergraduate business students’ performance in their chosen field. Does gender matter? Global Conference on Business and Finance Proceedings, 15(2), 2-21. https://www.theibfr.com/wp-content/uploads/2021/01/ISSN-1941-8589-V15-N2-2020.pdf

Opstad, L., & Årethun, T. (2020b). Skills, gender, and performance matter when undergraduate business students choose specialisation within business courses. International Journal of Management, Knowledge and Learning, 9(1), 95-107. http://www.issbs.si/press/ISSN/2232-5697/9_95-107.pdf

Parker, A. M., Watson, E., Dyck, N., & Carey, J. P. (2021). Traditional versus open-book exams in remote course delivery: A narrative review of the literature. In Proceedings of the Canadian Engineering Education Association (CEEA-ACEG21). https://doi.org/10.24908/pceea.vi0.14845

Raman, R., Sairam, B., Veena, G., Vachharajani, H., & Nedungadi, P. (2021). Adoption of online proctored examinations by university students during COVID-19: Innovation diffusion study. Education and Information Technologies, 26, 7339-7358. https://doi.org/10.1007/s10639-021-10581-5

Roelle, J., & Berthold, K. (2017). Effects of incorporating retrieval into learning tasks: The complexity of the tasks matters. Learning and Instruction, 49, 142-156. https://doi.org/10.1016/j.learninstruc.2017.01.008

Schoenmakers, B., & Wens, J. (2021). Efficiency, usability, and outcomes of proctored next-level exams for proficiency testing in primary care education: observational study. JMIR Formative Research, 5(8), e23834. https://doi.org/10.2196/23834

Senel, S., & Senel, H. C. C. (2021). Use of take-home exam for remote assessment: a case study from Turkey Journal of Educational Technology and Online Learning, 4(2), 236-255. https://doi.org/10.31681/jetol.912965

Spiegel, T., & Nivette, A. (2021). The relative impact of in-class closed-book versus take-home open-book examination type on academic performance, student knowledge retention and wellbeing. Assessment & Evaluation in Higher Education. Advance online publication. https://doi.org/10.1080/02602938.2021.2016607

Tatar, A. E., & Düştegör, D. (2020). Prediction of academic performance at undergraduate graduation: Course grades or grade point average? Applied Sciences, 10(14), Article 4967. https://doi.org/10.3390/app10144967

Watson, G. R., & Sottile, J. (2010). Cheating in the digital age: Do students cheat more in online courses? Online Journal of Distance Learning Administration, 13(1). https://ojdla.com/archive/spring131/watson131.pdf

Whitley, B. E. (1998). Factors associated with cheating among college students: A review. Research in Higher Education, 39(3), 235-274. https://doi.org/10.1023/A:1018724900565

Announcement

EDUPIJ News!

► Journal Metrics

  • 9% acceptance rate
  • 1.8 (2022) CiteScore (Scopus)
  • Q3 (2022) CiteScore Best Quartile
  • 0.294 (2022) Scimago Journal & Country Rank (SJR)
  • 0.612 (2022) Source-Normalized Impact per Paper (SNIP) 

EDUPIJ Statistics from Scopus

CiteScore: 1.8, view Scopus page

SCImago Journal & Country Rank

► Educational Process: International Journal is member of the Committee on Publication Ethics (COPE). 

► New issue coming soon! (Volume 13 Issue 2, 2024)