Details
Original language | English |
---|---|
Number of pages | 6 |
Publication status | E-pub ahead of print - 20 Jun 2025 |
Abstract
Cite this
- Standard
- Harvard
- Apa
- Vancouver
- BibTeX
- RIS
6 p. 2025.
Research output: Other contribution › Other publication › Research › peer review
}
TY - GEN
T1 - Error Classification in Stoichiometry Tutoring Systems with Different Levels of Scaffolding: Comparing Rule-Based Classification and Machine Learning
AU - Fleischer, Hendrik
AU - Borchers, Conrad
AU - Schanze, Sascha
AU - Aleven, Vincent
PY - 2025/6/20
Y1 - 2025/6/20
N2 - Comparing rule-based and machine learning (ML) approaches to error classification is crucial for advancing adaptive instruction. However, few studies have examined their comparative accuracy for tutoring systems with different levels of scaffolding. The present study addresses this gap by examining the classification of stoichiometry errors using data from 61 science students enrolled at a public German university who interacted with two distinct tutoring systems. We annotated 1,164 error clips from log data and derived an error classification scheme with eight categories covering system-related (e.g., usability) and domain-specific (e.g., unit conversion) categories. We developed decision rules and trained an ML model, comparing automatically classified errors in segments of learner inputs to classifications based on our expert model. Our results indicate that domain-specific errors requiring procedural knowledge are more accurately classified by the rule-based classifier, while concept-based errors are better captured by ML, though only in a lowly scaffolded tutoring system. These findings suggest researchers must carefully choose modeling approaches to address misconceptions in STEM learning.
AB - Comparing rule-based and machine learning (ML) approaches to error classification is crucial for advancing adaptive instruction. However, few studies have examined their comparative accuracy for tutoring systems with different levels of scaffolding. The present study addresses this gap by examining the classification of stoichiometry errors using data from 61 science students enrolled at a public German university who interacted with two distinct tutoring systems. We annotated 1,164 error clips from log data and derived an error classification scheme with eight categories covering system-related (e.g., usability) and domain-specific (e.g., unit conversion) categories. We developed decision rules and trained an ML model, comparing automatically classified errors in segments of learner inputs to classifications based on our expert model. Our results indicate that domain-specific errors requiring procedural knowledge are more accurately classified by the rule-based classifier, while concept-based errors are better captured by ML, though only in a lowly scaffolded tutoring system. These findings suggest researchers must carefully choose modeling approaches to address misconceptions in STEM learning.
UR - https://doi.org/10.35542/osf.io/edpgk_v1
U2 - 10.35542/osf.io/edpgk_v1
DO - 10.35542/osf.io/edpgk_v1
M3 - Other publication
ER -