AsPeer: Method to Self and Peer Assessment in Large Online Design Classes

Authors

  • Hariesh K Sankaran Karnavati University, Gandhinagar, Gujrat, India
  • Raju Shanmugam Karnavati University, Gandhinagar, Gujrat, India https://orcid.org/0000-0002-8613-9518
  • Bhavesh Shah Karnavati University, Gandhinagar, Gujrat, India
  • Sultan Ahmad Prince Sattam Bin Abdulaziz University, Al-Kharj, Saudi Arabia https://orcid.org/0000-0002-3198-7974
  • Hikmat A. M. Abdeljaber Applied Science Private University, Amman, Jordan
  • Jabeen Nazeer Prince Sattam Bin Abdulaziz University, Al- Kharj, Saudi Arabia

DOI:

https://doi.org/10.3991/ijet.v18i10.38617

Keywords:

Peer assessment, Self-assessment, Online education, Design studio, Qualitative feedback

Abstract


Peer and self-assessment open opportunities to scale assessments in online classrooms. This article reports our experiences of using AsPeer- peer assessment system, with two iterations of a university online class. We observed that peer grades highly correlated with staff assigned grades. It was recorded that, the peer grade of all student submissions within the range of instructor grade averaged to 21.0% and that within the next 2 ranges was 49.0%. We performed three experiments to improve accuracy of peer grading. First, we observed grading bias and introduced a data driven feedback mechanism to inform peers of it. Students aided by feedback were mindful and performed grading with better accuracy. Second, we observed that the rubric lacked efficiency in translating intent to students.  Simplified guiding questions improved accuracy in assessment by 89% of students. Third, we encouraged peers to provide personalized qualitative feedback along with rating. We provided them with feedback snippets that addressed common issues. 64% of students responded that the snippets helped them to critically look at submissions before rating.

Author Biographies

Hariesh K Sankaran, Karnavati University, Gandhinagar, Gujrat, India

Hariesh K Sankaran (0000-0001-5818-199X) is a research scholar at Karnavati University. He is an architect, product designer and urbanist presently working on domains concerned with the future of tech enabled online design education.

Raju Shanmugam, Karnavati University, Gandhinagar, Gujrat, India

Raju Shanmugam(0000-0002-8613-9518) is a doctoral mentor and supervisor at Karnavati University. He is the dean of the School of Computational Intelligence at Karnavati University.

Bhavesh Shah, Karnavati University, Gandhinagar, Gujrat, India

Bhavesh Shah (0009-0003-3906-9048) is a doctoral mentor and supervisor at Karnavati University. He is a practicing architect and research mentor at the Karnavati School of Research.

Sultan Ahmad , Prince Sattam Bin Abdulaziz University, Al-Kharj, Saudi Arabia

Sultan Ahmad (0000-0002-3198-7974) is an IEEE member and currently working as Senior faculty in Department of Computer Science, College of Computer Engineering and Sciences, Prince Sattam Bin Abdulaziz University, Al- Kharj, Saudi Arabia. He has more than 15 years of teaching and research experience. He has around 75 accepted and published research papers and book chapters in reputed SCI, SCIE, ESCI and SCOPUS indexed journals and conferences. He has an Australian Patent in his name also. He has authored 4 books that are available on Amazon. His research area includes Intelligence computing, big data, machine learning and Internet of Things. He has presented his research papers in many national and international conferences. He is a Member of IEEE, IACSIT and Computer Society of India.

Hikmat A. M. Abdeljaber, Applied Science Private University, Amman, Jordan

Hikmat A. M. Abdeljaber (0000-0001-9557-3933) is Asst. Professor in Department of Computer Science, Faculty of Information Technology, Applied Science Private University, Amman, Jordan.  He was born in Kuwait, in 1967. He received the Ph.D. degree in information sciences and technology in 2010 from the Universiti Kebangsaan Malaysia, UKM, Malaysia. He has published papers in the area of information retrieval and artificial intelligence. His research interests include information retrieval, semantic web technology, data mining and machine learning.  

Jabeen Nazeer, Prince Sattam Bin Abdulaziz University, Al- Kharj, Saudi Arabia

Jabeen Nazeer(0000-0002-9242-6230) is lecturer in Department of Computer Science, College of Computer Engineering and Sciences, Prince Sattam Bin Abdulaziz University, Al- Kharj, Saudi Arabia. He has more than 20 years of teaching and research experience.

Cover iJET Vol. 18 No. 10 (2023)

Downloads

Published

2023-05-23

How to Cite

Sankaran, H. K. ., Shanmugam, R., Shah, B. ., Ahmad, S., Abdeljaber, H. A. M. ., & Nazeer, J. (2023). AsPeer: Method to Self and Peer Assessment in Large Online Design Classes. International Journal of Emerging Technologies in Learning (iJET), 18(10), pp. 19–38. https://doi.org/10.3991/ijet.v18i10.38617

Issue

Vol. 18 No. 10 (2023)

Section

Papers

License

Copyright (c) 2023 Hariesh K. Sankaran, Raju Shanmugam, Bhavesh Shah, Sultan Ahmad

Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.

The submitting author warrants that the submission is original and that she/he is the author of the submission together with the named co-authors; to the extend the submission incorporates text passages, figures, data or other material from the work of others, the submitting author has obtained any necessary permission.
Articles in this journal are published under the Creative Commons Attribution Licence (CC-BY What does this mean?). This is to get more legal certainty about what readers can do with published articles, and thus a wider dissemination and archiving, which in turn makes publishing with this journal more valuable for you, the authors.
By submitting an article the author grants to this journal the non-exclusive right to publish it. The author retains the copyright and the publishing rights for his article without any restrictions.