Examining Social Justice Implications of Proctoring Technologies in Online Assessments within Open and Distance e-Learning (ODeL) Environments: Privacy, Equity, and Access

Siyanda Cele; Mncedisi Christian Maphalala

doi:10.31949/ijeir.v4i1.12773

Authors

Siyanda Cele University of South Africa https://orcid.org/0009-0008-9020-0095
Mncedisi Christian Maphalala University of South Africa https://orcid.org/0000-0002-1078-1985

DOI:

https://doi.org/10.31949/ijeir.v4i1.12773

Abstract

The study explores the social justice implications of proctoring technologies in online assessments within Open and Distance e-learning (ODeL) environments, focusing on privacy, equity, and access. Through a systematic literature review (SLR) adhering to PRISMA protocols, the study analyses peer-reviewed empirical research published between 2014 and 2024. Key thematic areas identified include the ethical concerns surrounding privacy and surveillance, the impact of proctoring technologies on equitable access to assessments, and the potential biases embedded within automated monitoring systems. The study highlights the need for fair and transparent strategies for online proctoring in Open and Distance e-Learning (ODeL) environments. It is essential to balance maintaining academic integrity and respecting students' privacy and ethical concerns. Proctoring technologies should align with Social Justice Theory to safeguard students' rights to privacy, equal access, and active participation. Future studies should focus on developing policies and technologies that enhance fairness and trust while protecting students' rights during online assessments.

Keywords:

Social Justice, Online Proctoring, Privacy, Equity, Open and Distance e-Learning

Downloads

Download data is not yet available.

Author Biography

Mncedisi Christian Maphalala, University of South Africa

Prof Mncedisi Maphalala is a Full-Professor in the Department of Curriculum and Instructional Studies at Unisa (College of Education). He is a former Director: of the Centre for Excellence in Learning and Teaching (CELT) at the Durban University of Technology and a former Dean in the Faculty of Education at the University of Zululand. He holds a D.Ed in curriculum studies from the University of Zululand. His career in Higher Education spans over 19 years as a Research Professor (North-West University), Professor at the University of Zululand and UNISA and Institutional researcher at the University of the Witwatersrand. He has also previously worked for the KZN Department of Education (as a teacher, HOD and Deputy Principal); between May and August 2015, he was a Visiting Scholar at the University of North Dakota (USA). Prof Maphalala is an established researcher who holds an NRF C2 rating. He has edited books and special journal issues and published a number of book chapters and research articles in peer-reviewed journals. Prof Maphalala has presented research papers at various local and international conferences. As a postgraduate supervisor and mentor, Prof Maphalala has supervised to completion several Masters and doctoral candidates. He has conducted a number of large-scale commissioned research projects by external organisations such as the South African Institute of Distance Education (SAIDE), Human Sciences Research Council (HSRC), and Council on Higher Education (CHE). He has served on the Umalusi Research Forum, a sub-committee of the Umalusi Council, for a four-year term. His research interests are teacher education, self-directed learning, blended learning, Scholarship of Teaching & Learning and Curriculum studies.

References

Aagaard, J. (2017). The ambivalence of technology: A critical examination of technological determinism and ambivalence in educational technology. Learning, Media and Technology, 42(4), 417-433. https://doi.org/10.1080/17439884.2017.1369103

Aditya Nigam, Rhitvik Pasricha, Tarishi Singh and Prathamesh Churi. 2021. A Systematic Review on AI-based Proctoring Systems: Past, Present and Future. Education and Information Technologies, 26, 5 (2021/09/01), 6421-6445.

Aktaş, C. B. (2021). Enhancing social justice and socially just pedagogy in higher education through participatory action research. Teaching in Higher Education, 29(1), 159–175. https://doi.org/10.1080/13562517.2021.1966619

Alexandra Okada, Peter Scott and Murilo Mendonca. 2015. Effective web videoconferencing for proctoring online oral exams: A case study at scale in Brazil. Open Praxis, 7, 3, 227-242.

Al-Maqbali, A., & Hussain, R. M. R. (2022). The impact of online assessment challenges on assessment principles during COVID-19 in Oman. Journal of University Teaching and Learning Practice, 19(2), 73–92. https://doi.org/10.53761/1.19.2.6

Archer, E. (2023). Technology-driven proctoring: Validity, social justice and ethics in higher education. Perspectives in Education, 41(1), 119–136. https://doi.org/10.38140/pie.v41i1.6666

Azionya, C. M., & Nhedzi, A. (2021). The Digital Divide and Higher Education Challenge With Emergency Online Learning: Analysis of Tweets in the Wake Of The Covid-19 Lockdown. Turkish Online Journal of Distance Education, 164–182. https://doi.org/10.17718/tojde.1002822

Banerjee, M. (2022). The Digital Divide and Smartphone Reliance for Disadvantaged Students in Higher Education. Journal of Systemics, Cybernetics, and Informatics/Journal of Systemics Cybernetics and Informatics, 20(3), 31–39. https://doi.org/10.54808/jsci.20.03.31

Barria-Pineda, J. (2020). Transparency in proctoring technologies: Balancing fairness and privacy in online assessments. Journal of Educational Technology Systems, 48(4), 455–468.

Bennett, S., & Maton, K. (2015). Beyond the "digital natives" debate: Towards a more inclusive understanding of digital literacy. Journal of Educational Technology Research and Development, 63(1), 1-20.

Binns, R. (2018). Privacy and Surveillance in Online Learning: A Critical Analysis. Journal of Educational Technology Systems, 47(4), 413-431.

Binns, R. (2018). The Risk of Algorithmic Bias in Educational Technologies: A Case Study of Online Proctoring. Journal of Educational Technology, 15(2), 102-119.

Bryson, C., et al. (2020). Surveillance and Stress in Online Learning: Student Perspectives on Proctoring Technologies. Journal of Distance Education, 34(3), 27-44.

Bryson, C., Hand, L., & Jones, R. (2020). The surveillance of learning: Impact of proctoring technologies on student agency and engagement. Studies in Higher Education, 45(9), 1724–1739.

Campbell, B. (2021). Social Justice and Sociological Theory. Society, 58(5), 355–364. https://doi.org/10.1007/s12115-021-00625-4

Campbell, E. (2008). The ethics of teaching as a moral profession. Curriculum Inquiry, 38(4), 357-385. https://doi.org/10.1111/j.1467-873X.2008.00414.x

Chen, B., Bennett, S., & Maton, K. (2015). Transparency and fairness in educational technology implementation. Journal of Educational Technology Research and Development, 63(1), 1-20.

Coghlan, S., Miller, T. & Paterson, J. Good Proctor or “Big Brother”? Ethics of Online Exam Supervision Technologies. Philos. Technol. 34, 1581–1606 (2021). https://doi.org/10.1007/s13347-021-00476-1

Coghlan, S., Miller, T., & Paterson, J. (2021). "Fairness—Equity and Accessibility in AI Use." Journal of Educational Technology Studies.

Coghlan, S., Miller, T., & Paterson, J. (2021). Ethical Challenges in Online Proctoring Technologies. Journal of Academic Integrity, 16(4), 205–230.

Coghlan, S., Miller, T., & Paterson, J. (2021). Good Proctor or “Big Brother”? Ethics of Online Exam Supervision Technologies. Philosophy & Technology, 34(4), 1581–1606. https://doi.org/10.1007/s13347-021-00476-1

Diaz, P., Johnson, K., & White, R. (2021). "Digital Divide and Online Proctoring: Challenges in Remote Assessments." International Journal of E-Learning Research.

Diaz, R., et al. (2021). The Digital Divide in Online Learning: Examining Access Barriers in Remote Education. International Journal of Educational Technology, 18(1), 14-29.

Dimeo, J. (2017). "Online Exam Proctoring Catches Cheaters, Raises Concerns." Inside Higher Ed. 10.

Duncan, A., & Joyner, D. (2022). On the necessity (or lack thereof) of digital proctoring: Drawbacks, perceptions, and alternatives. Journal of Computer Assisted Learning, 38(5), 1482–1496. https://doi.org/10.1111/jcal.12700

Eubanks, V. (2018). Automating Inequality: How High-Tech Tools Profile, Police, and Punish the Poor. St. Martin’s Press.

Faloye, S. T., & Ajayi, N. (2021). Understanding the impact of the digital divide on South African students in higher educational institutions. African Journal of Science Technology Innovation and Development, 14(7), 1734–1744. https://doi.org/10.1080/20421338.2021.1983118

Fawns, T., & Schaepkens, S. (2022a). A Matter of Trust: Online Proctored Exams and the Integration of Technologies of Assessment in Medical Education. Teaching and Learning in Medicine, 34(4), 444–453. https://doi.org/10.1080/10401334.2022.2048832

Fawns, T., & Schaepkens, S. (2022b). A Matter of Trust: Online Proctored Exams and the Integration of Technologies of Assessment in Medical Education. Teaching and Learning in Medicine, 34(4), 444–453. https://doi.org/10.1080/10401334.2022.2048832

Fisher, E. (2019). The human-technology relationship: Insights into educational proctoring systems. Ethics and Information Technology, 21(3), 205-217.

Fynn, A., & Mashile, E. O. (2022a). Continuous online assessment at a South African open distance and e-Learning institution. Frontiers in Education, 7. https://doi.org/10.3389/feduc.2022.791271

Fynn, A., & Mashile, E. O. (2022b). Continuous Online Assessment at a South African Open Distance and e-Learning Institution. Frontiers in Education, 7. https://doi.org/10.3389/feduc.2022.791271

Gallagher, S. E., Lester, J., Nguyen, T., & Klein, E. (2021). Responsible innovation in educational technology: A framework for trust and equity. Educational Technology Research and Development, 69(4), 1-20.

Gezani, B. (2024). Challenges of Online Learning in the Comprehensive Open Distance and Elearning Context – A Case Study of the University of South Africa. E-Journal of Humanities Arts and Social Sciences, 1265–1274. https://doi.org/10.38159/ehass.20245716

Gordon OReilly and John Creagh. 2016. A Categorization of Online Proctoring. In Proceedings of the Global Learn 2016 (Limerick, Ireland, 2016). Association for the Advancement of Computing in Education (AACE).

Graham, C., & Conner, D. (2020). Technological Inequity and Its Impact on Learning in Distance Education. Journal of Educational Access and Technology, 11(2), 53-67.

Graham, C., & Conner, T. (2020). Student perceptions of fairness and transparency in online assessment proctoring systems. Journal of Online Learning Research, 6(3), 235–250.

Graham, R., & Conner, T. (2020). "Socio-Economic Barriers in Online Education." Open Distance Learning Journal.

Greenwood, J. (2021). Legal Implications of Data Collection in Online Learning: A Comparative Review of Global Policies. International Journal of Data Privacy, 6(4), 213-227.

Greenwood, L. (2021). Privacy and Security in Educational Technologies: A Legal Perspective. Technology and Education Quarterly, 13(2), 87–100.

Gribbins, M., & Bonk, C. J. (2023). An exploration of instructors’ perceptions about online proctoring and its value in ensuring academic integrity. British Journal of Educational Technology, 54(6), 1693–1714. https://doi.org/10.1111/bjet.13389

Hansen, D. T. (1998). Teaching as a moral activity. Curriculum Inquiry, 28(4), 399-409. https://doi.org/10.1111/0362-6784.00101

Hartnett, M., Butler, P., & Rawlins, P. (2023). Online proctored exams and digital inequalities during the pandemic. Journal of Computer Assisted Learning, 39(4), 1103–1115. https://doi.org/10.1111/jcal.12813

Heil, J., & Ifenthaler, D. (2023). Online Assessment in Higher Education: A Systematic Review. Online Learning, 27(1). https://doi.org/10.24059/olj.v27i1.3398

Hussein, M. J., Yusuf, J., Deb, A. S., Fong, L., & Naidu, S. (2020). An Evaluation of Online Proctoring Tools. Open Praxis, 12(4), 509. https://doi.org/10.5944/openpraxis.12.4.1113

Ifenthaler, D., & Tracey, M. (2016). Exploring ethical considerations in educational technology adoption. Computers & Education, 95, 75–87.

Iftikhar, A., Ahmed, N., & Shah, S. U. M. (2023). Analyzing digital divide among university students of Pakistan. Turkish Online Journal of Distance Education, 24(2), 261–271. https://doi.org/10.17718/tojde.1105081

Isbell, D. R., Kremmel, B., & Kim, J. (2023). Remote Proctoring in Language Testing: Implications for Fairness and Justice. Language Assessment Quarterly, 20(4–5), 469–487. https://doi.org/10.1080/15434303.2023.2288251

Jacobs, L., & Mncube, S. (2023). Proctoring as a human substitution for online summative assessments in a comprehensive open distance e-learning institution: Opportunities and obstacles. The Independent Journal of Teaching and Learning, 18(2), 93–108. https://doi.org/10.17159/ijtl.v18i2.17313

Johri, A. (2022). Fairness and equity in AI-driven educational systems. AI & Society, 37(2), 213-231.

Kearnes, M., & Wynne, B. (2007). On the limits of technological determinism: Ambivalence and agency in technological adoption. Technology and Society, 32(4), 387–403.

Khalil, M., Prinsloo, P., & Slade, S. (2022). In the nexus of integrity and surveillance: Proctoring (re)considered. Journal of Computer Assisted Learning, 38(6), 1589–1602. https://doi.org/10.1111/jcal.12713

Kitchenham, B. (2004). Procedures for performing systematic reviews. Keele University Technical Report.

Klein, E., Lester, J., Nguyen, T., & Gallagher, S. E. (2020). Ethical guidelines for online proctoring: Building trust through transparency. Journal of Technology Ethics, 15(2), 215–232.

Kumar, P., & Singh, R. (2021). Ethical concerns in algorithmic fairness: A critical review. AI Ethics Journal, 2(3), 124-139.

Kumar, R., & Singh, A. (2021). Gendered Biases in Proctoring Systems: A Critical Analysis of AI Surveillance. Journal of Gender Studies, 32(3), 412-426.

Lee, K., & Fanguy, M. (2022). Online exam proctoring technologies: Educational innovation or deterioration? British Journal of Educational Technology, 53(3), 475–490. https://doi.org/10.1111/bjet.13182

Lex Sietses. 2020. White paper Online proctoring. Questions and answers about remote proctoring., SURF.

Lumadi, M. (2023). In pursuit of equity in assessment among indigent an assessment. Alternation Interdisciplinary Journal for the Study of the Arts and Humanities in Southern Africa, 39(1). https://doi.org/10.29086/2519-5476/2022/sp39a4

Majola, M. X., & Mudau, P. K. (2022). Lecturers’ Experiences of Administering Online Examinations at a South African Open Distance e-Learning University During the COVID-19. International Journal of Educational Methodology, 8(2), 275–283. https://doi.org/10.12973/ijem.8.2.275

Maniram, R. (2023). Recounting the Learning Challenges Experienced by Students from Rural Areas in South Africa in the Context of a Pandemic. African Journal of Inter/Multidisciplinary Studies, 5(1), 1–12. https://doi.org/10.51415/ajims.v5i1.1298

Mareen, S., & Davids, M. (2022). COVID-19 catalysing assessment transformation: A case of the online open book examination. South African Journal of Higher Education, 36(3), 109–122. https://doi.org/10.20853/36-3-4732

McArthur, J., & Ashwin, P. (2020). Locating Social Justice in Higher Education Research. https://doi.org/10.5040/9781350086784

McGrath, J. (2020). Surveillance in Online Education: Implications for Equity. Digital Education Review, 12(1), 45–62.

McGrath, M. (2020). Ethical Implications of AI in Education: Balancing Surveillance and Student Privacy. Educational Policy Review, 59(2), 235-249.

Mettl. (2018). Mettl ProctorPlus—Experience the Real Power of AI. https://www.youtube.com/watch?v=_YPu9X3TCXY&feature=youtu.be.

Mohammed Juned Hussein, Javed Yusuf, Arpana Sandhya Deb, Letila Fong and Som Naidu. 2020. An evaluation of online proctoring tools. Open Praxis, 12, 4, 509-525.

Moher, D., Liberati, A., Tetzlaff, J., & Altman, D. G. (2009). Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement. PLOS Medicine, 6(7), e1000097.Norman, D. (2020). Online exam proctoring. D’Arcy Norman Dot Net. https://darcynorman.net/2020/03/31/online-exam-proctoring/. Accessed 24 Jul 2021

Mphahlele, R. (2024). A Review of Research on Collaborative Assessments in the Open Distance and e-Learning Environment. Journal of Learning for Development, 11(2), 206–219. https://doi.org/10.56059/jl4d.v11i2.762

Mphahlele, R. S. (2021a). Digital Assessment Literacy in Online Courses (Formative/Summative). In Advances in mobile and distance learning book series (pp. 404–417). https://doi.org/10.4018/978-1-7998-8701-0.ch020

Mphahlele, R. S. (2021b). Digital Assessment Literacy in Online Courses (Formative/Summative). In Advances in mobile and distance learning book series (pp. 404–417). https://doi.org/10.4018/978-1-7998-8701-0.ch020

Mwangi, A. (2021). Advantage of Adoption of Open Distance and E-Learning to Increase Access to Female Higher Education. Journal of Online and Distance Learning, 1(1), 1–13. https://doi.org/10.47941/jodl.634

Nalyvaiko, O., Zhernovnykova, O., Nalyvaiko, N., & Molotok, V. (2022). Academic Integrity in the Conditions Forced Distance Learning. Open Educational E-Environment of Modern University, 13, 89–103. https://doi.org/10.28925/2414-0325.2022.137

Neil Selwyn, Chris O'Neill, Gavin Smith, Mark Andrejevic and Xin Gu. 2021. A necessary evil? The rise of online exam proctoring in Australian universities. Media International Australia, 1-16.

Ntshoe, I. (2020). Ontologising social justice in decolonised and post-apartheid settings. South African Journal of Higher Education, 34(3). https://doi.org/10.20853/34-3-3283

Okoli, C., & Schabram, K. (2010). A guide to conducting a systematic literature review of information systems research. Communications of the Association for Information Systems, 37(1), 43.

Paredes, S. G., De Jesús Jasso Peña, F., & De La Fuente Alcazar, J. M. (2021). Remote proctored exams: Integrity assurance in online education? Distance Education, 42(2), 200–218. https://doi.org/10.1080/01587919.2021.1910495

Parnther, C., & Eaton, S. E. (2021). Issues and Problems in Educational Surveillance and Proctoring Technologies. Canadian Perspectives on Academic Integrity, 4(2), 20–21. https://doi.org/10.55016/ojs/cpai.v4i2.74157

Patel, M., Braaf, N., Chinnian, K., & Mohammed, T. (2023). Online Assessments for Reflection within a Large Class: A Case Study of English for Educational Development Law Students at the University of the Western Cape. ALTRALANG Journal, 5(01), 336–354. https://doi.org/10.52919/altralang.v5i01.286

Patterson, B. Q. (2021). Race for Social Justice in Higher Education. In Advances in religious and cultural studies (ARCS) book series (pp. 138–156). https://doi.org/10.4018/978-1-7998-8532-0.ch009

Prihartono, A., Muhtar, M. H., Kamba, S. N. M., Kasim, N. M., & Apripari, A. (2023). Beyond Rhetoric: A Critical Examination of Social Justice Theory In Development. Journal of Namibian Studies, 33(1), 2601-2617.

Rambe, P., & Nel, L. (2015). Technological ambivalence in online examinations: The dual impact on student agency. British Journal of Educational Technology, 46(6), 1248-1263.

Reshma, R. N. (2018). Negotiating with the ‘Principles of Social Justice.’ Asian Journal of Political Science, 27(1), 150–152. https://doi.org/10.1080/02185377.2018.1506993

Riley, T., Soloway, A., & Brewer, T. (2014). Outcomes-based education: Implications for learning processes in a digital age. Education and Information Technologies, 19(3), 337–356.

Selwyn, N., et al. (2021). "Bias in AI Systems for Education: A Critical Review." AI and Society.

Selwyn, N., O’Neill, C., Smith, G., Andrejevic, M., & Gu, X. (2021a). A necessary evil? The rise of online exam proctoring in Australian universities. Media International Australia, 186(1), 149–164. https://doi.org/10.1177/1329878x211005862

Selwyn, N., O’Neill, C., Smith, G., Andrejevic, M., & Gu, X. (2021b). A necessary evil? The rise of online exam proctoring in Australian universities. Media International Australia, 186(1), 149–164. https://doi.org/10.1177/1329878x211005862

Simone Arnò, Alessandra Galassi, Marco Tommasi, Aristide Saggino and Pierpaolo Vittorini. 2021. State-of-the-Art of Commercial Proctoring Systems and Their Use in Academic Online Exams. International Journal of Distance Education Technologies (IJDET), 19, 2, 55-76.

Smith, A. (2020). Online proctoring: Trust, transparency, and fairness. Journal of Online Learning, 5(3), 15-20.

Spector, J. M. (2016). Ethical and responsible practices in educational technology: Guidelines and challenges. Educational Technology Research and Development, 64(5), 785–802.

Swager, S. (2020). "Our Bodies Encoded: Algorithmic Test Proctoring in Higher Education." Hybrid Pedagogy.

Sweeney, L., & Cuthbert, D. (2020). Data Security and Online Education: Navigating the Risks of Proctoring Technologies. Journal of Educational Law, 45(2), 56-71.

Sweeney, T., & Cuthbert, R. (2020). Balancing Exam Integrity and Privacy in Online Learning Environments. Journal of Distance Learning, 24(3), 95–118.

Timmons, J., & Phelps, L. (2022). Anxiety and student agency in proctored online exams. Higher Education Studies, 12(1), 48–59.

Timmons, L., & Phelps, M. (2022). "Psychological Impacts of Online Proctoring." Journal of Education Equity.

Timmons, M., & Phelps, L. (2022). Technology Gaps and Assessment Outcomes: Addressing Inequity in Online Education. Journal of Educational Equity, 25(4), 67-79.

Ulriksen, M. S., & Plagerson, S. (2021). Bringing Theory to Life in Social Justice Research. Southern African Journal of Social Work and Social Development, 34(1). https://doi.org/10.25159/2708-9355/8648

Walter, R. R. (2016). Emancipatory Nursing Praxis. Advances in Nursing Science, 40(3), 225–243. https://doi.org/10.1097/ans.0000000000000157

Woldeab, D., et al. (2017). "Under the Watchful Eye of Online Proctoring." Innovative Learning and Teaching.

Woldegiorgis, E. T. (2022). Mitigating the digital divide in the South African higher education system in the face of the Covid-19 pandemic. Perspectives in Education, 40(3), 197–211. https://doi.org/10.18820/2519593x/pie.v40.i3.13

Yoder-Himes, D. R., Asif, A., Kinney, K., Brandt, T. J., Cecil, R. E., Himes, P. R., Cashon, C., Hopp, R. M. P., & Ross, E. (2022). Racial, skin tone, and sex disparities in automated proctoring software. Frontiers in Education, 7. https://doi.org/10.3389/feduc.2022.881449

Yousef Atoum, Liping Chen, Alex X. Liu, Stephen D. H. Hsu and Xiaoming Liu. 2017. Automated Online Exam Proctoring. IEEE Transactions on Multimedia, 19, 7, 1609-1624.

Examining Social Justice Implications of Proctoring Technologies in Online Assessments within Open and Distance e-Learning (ODeL) Environments: Privacy, Equity, and Access

Authors

DOI:

Abstract

Keywords:

Downloads

Author Biography

Mncedisi Christian Maphalala, University of South Africa

References

Downloads

Published

How to Cite

Issue

Section

License

Similar Articles

Journal information

For Author

Indexing

Visitors