Hybrid Evaluation of Socratic Dialogue for Teaching

Publikation: Beitrag in Buch/Bericht/Sammelwerk/KonferenzbandAufsatz in KonferenzbandForschungPeer-Review

Autorschaft

Organisationseinheiten

Externe Organisationen

  • GESIS - Leibniz-Institut für Sozialwissenschaften
Forschungs-netzwerk anzeigen

Details

OriginalspracheEnglisch
Titel des Sammelwerks2024 Harmonising Generative AI and Semantic Web Technologies
PublikationsstatusVeröffentlicht - 13 Nov. 2025
Veranstaltung2024 Harmonising Generative AI and Semantic Web Technologies, HGAIS 2024 - Baltimore, USA / Vereinigte Staaten
Dauer: 13 Nov. 202413 Nov. 2024

Publikationsreihe

NameCEUR workshop proceedings
Herausgeber (Verlag)CEUR Workshop
Band3953
ISSN (Print)1613-0073

Abstract

We present a kick-starter paper that addresses the opportunities and challenges in the intersection of Generative AI (GenAI), Semantic Web Technologies, and Human-Computer Interaction in Socratic method for educational purposes. Inspired by the example of Large Language Model (LLM) tutors using the Socratic dialogue for teaching, we motivate the need for new hybrid benchmarks and metrics that calculate the tutor’s performance by combining parameters from the LLMs, Knowledge Engineering (KE) and Hybrid Human Artificial Intelligence (HHAI) performance. We explore current problems, and propose a future direction for the hybrid implementation of Socratic dialogue with hybrid evaluation methods.

ASJC Scopus Sachgebiete

Zitieren

Hybrid Evaluation of Socratic Dialogue for Teaching. / Ilkou, Eleni; Linzbach, Stephan; Wallat, Jonas.
2024 Harmonising Generative AI and Semantic Web Technologies. 2025. (CEUR workshop proceedings; Band 3953).

Publikation: Beitrag in Buch/Bericht/Sammelwerk/KonferenzbandAufsatz in KonferenzbandForschungPeer-Review

Ilkou, E, Linzbach, S & Wallat, J 2025, Hybrid Evaluation of Socratic Dialogue for Teaching. in 2024 Harmonising Generative AI and Semantic Web Technologies. CEUR workshop proceedings, Bd. 3953, 2024 Harmonising Generative AI and Semantic Web Technologies, HGAIS 2024, Baltimore, Maryland, USA / Vereinigte Staaten, 13 Nov. 2024. <http://ceur-ws.org/Vol-3953/>
Ilkou, E., Linzbach, S., & Wallat, J. (2025). Hybrid Evaluation of Socratic Dialogue for Teaching. In 2024 Harmonising Generative AI and Semantic Web Technologies (CEUR workshop proceedings; Band 3953). http://ceur-ws.org/Vol-3953/
Ilkou E, Linzbach S, Wallat J. Hybrid Evaluation of Socratic Dialogue for Teaching. in 2024 Harmonising Generative AI and Semantic Web Technologies. 2025. (CEUR workshop proceedings).
Ilkou, Eleni ; Linzbach, Stephan ; Wallat, Jonas. / Hybrid Evaluation of Socratic Dialogue for Teaching. 2024 Harmonising Generative AI and Semantic Web Technologies. 2025. (CEUR workshop proceedings).
Download
@inproceedings{ed5785f8497546fd935d2b574bbdcf8f,
title = "Hybrid Evaluation of Socratic Dialogue for Teaching",
abstract = "We present a kick-starter paper that addresses the opportunities and challenges in the intersection of Generative AI (GenAI), Semantic Web Technologies, and Human-Computer Interaction in Socratic method for educational purposes. Inspired by the example of Large Language Model (LLM) tutors using the Socratic dialogue for teaching, we motivate the need for new hybrid benchmarks and metrics that calculate the tutor{\textquoteright}s performance by combining parameters from the LLMs, Knowledge Engineering (KE) and Hybrid Human Artificial Intelligence (HHAI) performance. We explore current problems, and propose a future direction for the hybrid implementation of Socratic dialogue with hybrid evaluation methods.",
keywords = "Generative AI, Hybrid Benchmarks, Hybrid Human AI, Hybrid Metrics, Knowledge Graphs, Large Language Models, Socratic Method, Socratic Sub-questions",
author = "Eleni Ilkou and Stephan Linzbach and Jonas Wallat",
note = "Publisher Copyright: {\textcopyright} 2025 Copyright for this paper by its authors.; 2024 Harmonising Generative AI and Semantic Web Technologies, HGAIS 2024, HGAIS 2024 ; Conference date: 13-11-2024 Through 13-11-2024",
year = "2025",
month = nov,
day = "13",
language = "English",
series = "CEUR workshop proceedings",
publisher = "CEUR Workshop",
booktitle = "2024 Harmonising Generative AI and Semantic Web Technologies",

}

Download

TY - GEN

T1 - Hybrid Evaluation of Socratic Dialogue for Teaching

AU - Ilkou, Eleni

AU - Linzbach, Stephan

AU - Wallat, Jonas

N1 - Publisher Copyright: © 2025 Copyright for this paper by its authors.

PY - 2025/11/13

Y1 - 2025/11/13

N2 - We present a kick-starter paper that addresses the opportunities and challenges in the intersection of Generative AI (GenAI), Semantic Web Technologies, and Human-Computer Interaction in Socratic method for educational purposes. Inspired by the example of Large Language Model (LLM) tutors using the Socratic dialogue for teaching, we motivate the need for new hybrid benchmarks and metrics that calculate the tutor’s performance by combining parameters from the LLMs, Knowledge Engineering (KE) and Hybrid Human Artificial Intelligence (HHAI) performance. We explore current problems, and propose a future direction for the hybrid implementation of Socratic dialogue with hybrid evaluation methods.

AB - We present a kick-starter paper that addresses the opportunities and challenges in the intersection of Generative AI (GenAI), Semantic Web Technologies, and Human-Computer Interaction in Socratic method for educational purposes. Inspired by the example of Large Language Model (LLM) tutors using the Socratic dialogue for teaching, we motivate the need for new hybrid benchmarks and metrics that calculate the tutor’s performance by combining parameters from the LLMs, Knowledge Engineering (KE) and Hybrid Human Artificial Intelligence (HHAI) performance. We explore current problems, and propose a future direction for the hybrid implementation of Socratic dialogue with hybrid evaluation methods.

KW - Generative AI

KW - Hybrid Benchmarks

KW - Hybrid Human AI

KW - Hybrid Metrics

KW - Knowledge Graphs

KW - Large Language Models

KW - Socratic Method

KW - Socratic Sub-questions

UR - http://www.scopus.com/inward/record.url?scp=105003724208&partnerID=8YFLogxK

M3 - Conference contribution

AN - SCOPUS:105003724208

T3 - CEUR workshop proceedings

BT - 2024 Harmonising Generative AI and Semantic Web Technologies

T2 - 2024 Harmonising Generative AI and Semantic Web Technologies, HGAIS 2024

Y2 - 13 November 2024 through 13 November 2024

ER -

Von denselben Autoren