Details
| Original language | English |
|---|---|
| Title of host publication | 2024 Harmonising Generative AI and Semantic Web Technologies |
| Publication status | Published - 13 Nov 2025 |
| Event | 2024 Harmonising Generative AI and Semantic Web Technologies, HGAIS 2024 - Baltimore, United States Duration: 13 Nov 2024 → 13 Nov 2024 |
Publication series
| Name | CEUR workshop proceedings |
|---|---|
| Publisher | CEUR Workshop |
| Volume | 3953 |
| ISSN (Print) | 1613-0073 |
Abstract
We present a kick-starter paper that addresses the opportunities and challenges in the intersection of Generative AI (GenAI), Semantic Web Technologies, and Human-Computer Interaction in Socratic method for educational purposes. Inspired by the example of Large Language Model (LLM) tutors using the Socratic dialogue for teaching, we motivate the need for new hybrid benchmarks and metrics that calculate the tutor’s performance by combining parameters from the LLMs, Knowledge Engineering (KE) and Hybrid Human Artificial Intelligence (HHAI) performance. We explore current problems, and propose a future direction for the hybrid implementation of Socratic dialogue with hybrid evaluation methods.
Keywords
- Generative AI, Hybrid Benchmarks, Hybrid Human AI, Hybrid Metrics, Knowledge Graphs, Large Language Models, Socratic Method, Socratic Sub-questions
ASJC Scopus subject areas
- Computer Science(all)
- General Computer Science
Cite this
- Standard
- Harvard
- Apa
- Vancouver
- BibTeX
- RIS
2024 Harmonising Generative AI and Semantic Web Technologies. 2025. (CEUR workshop proceedings; Vol. 3953).
Research output: Chapter in book/report/conference proceeding › Conference contribution › Research › peer review
}
TY - GEN
T1 - Hybrid Evaluation of Socratic Dialogue for Teaching
AU - Ilkou, Eleni
AU - Linzbach, Stephan
AU - Wallat, Jonas
N1 - Publisher Copyright: © 2025 Copyright for this paper by its authors.
PY - 2025/11/13
Y1 - 2025/11/13
N2 - We present a kick-starter paper that addresses the opportunities and challenges in the intersection of Generative AI (GenAI), Semantic Web Technologies, and Human-Computer Interaction in Socratic method for educational purposes. Inspired by the example of Large Language Model (LLM) tutors using the Socratic dialogue for teaching, we motivate the need for new hybrid benchmarks and metrics that calculate the tutor’s performance by combining parameters from the LLMs, Knowledge Engineering (KE) and Hybrid Human Artificial Intelligence (HHAI) performance. We explore current problems, and propose a future direction for the hybrid implementation of Socratic dialogue with hybrid evaluation methods.
AB - We present a kick-starter paper that addresses the opportunities and challenges in the intersection of Generative AI (GenAI), Semantic Web Technologies, and Human-Computer Interaction in Socratic method for educational purposes. Inspired by the example of Large Language Model (LLM) tutors using the Socratic dialogue for teaching, we motivate the need for new hybrid benchmarks and metrics that calculate the tutor’s performance by combining parameters from the LLMs, Knowledge Engineering (KE) and Hybrid Human Artificial Intelligence (HHAI) performance. We explore current problems, and propose a future direction for the hybrid implementation of Socratic dialogue with hybrid evaluation methods.
KW - Generative AI
KW - Hybrid Benchmarks
KW - Hybrid Human AI
KW - Hybrid Metrics
KW - Knowledge Graphs
KW - Large Language Models
KW - Socratic Method
KW - Socratic Sub-questions
UR - http://www.scopus.com/inward/record.url?scp=105003724208&partnerID=8YFLogxK
M3 - Conference contribution
AN - SCOPUS:105003724208
T3 - CEUR workshop proceedings
BT - 2024 Harmonising Generative AI and Semantic Web Technologies
T2 - 2024 Harmonising Generative AI and Semantic Web Technologies, HGAIS 2024
Y2 - 13 November 2024 through 13 November 2024
ER -