Analysis of STACK Answer Data Using Pen-Stroke Data from a Calculation Notebook and Item Response Theory
Keywords:automatic assessment system for mathematics, pen-stroke data analysis, item response theory
One of the most significant features of STACK, an automatic assessment system for mathematics, is the automatic classification of correct, semi-correct and incorrect answers using the Potential Response Tree, and the presentation of appropriate feedback for each. However, the answers provided by students are only the results of their calculations, and if they are semi-correct or wrong, it is necessary to check the notes describing the calculations to determine where mistakes have been made. We developed a function that allows students to submit their notes at the same time as their STACK answers, thereby creating an environment in which teachers can check where students have made mistakes and where they have stumbled. The note submission can be in the form of saving the results of calculations made with a digital pen on a tablet. This study examines a method of analysing answer data by visualising and analysing pen-stroke data from notes submitted using the latter method, and linking this to correct/incorrect data. From pen-stroke data, two types of visualisation were achieved on the submitted notes. One was to colour-code the strokes according to the writing speed of the digital pen, and the other was to display the strokes as thicker if the stagnant time in which nothing was written was above a threshold value. The difficulty of the problem was estimated from those data. Then, the item response theory is used to verify whether the difficulty is correctly estimated.
How to Cite
Copyright (c) 2022 Yasuyuki Nakamura, Kazusa Fujimoto, Kako Ito
This work is licensed under a Creative Commons Attribution 4.0 International License.
The submitting author warrants that the submission is original and that she/he is the author of the submission together with the named co-authors; to the extend the submission incorporates text passages, figures, data or other material from the work of others, the submitting author has obtained any necessary permission.
Articles in this journal are published under the Creative Commons Attribution Licence (CC-BY What does this mean?). This is to get more legal certainty about what readers can do with published articles, and thus a wider dissemination and archiving, which in turn makes publishing with this journal more valuable for you, the authors.
By submitting an article the author grants to this journal the non-exclusive right to publish it. The author retains the copyright and the publishing rights for his article without any restrictions.
This journal has been awarded the SPARC Europe Seal for Open Access Journals (What's this?)