Does a language model “understand” high school math? A survey of deep learning based word problem solvers

Research output: Contribution to journalReview articleResearchpeer review

Authors

  • Sowmya S. Sundaram
  • Sairam Gurajada
  • Deepak Padmanabhan
  • Savitha Sam Abraham
  • Marco Fisichella

Research Organisations

External Research Organisations

  • Queen's University Belfast
  • Orebro University
  • IBM
View graph of relations

Details

Original languageEnglish
Number of pages27
JournalWiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery
Early online date24 Mar 2024
Publication statusE-pub ahead of print - 24 Mar 2024

Abstract

From the latter half of the last decade, there has been a growing interest in developing algorithms for automatically solving mathematical word problems (MWP). It is a challenging and unique task that demands blending surface level text pattern recognition with mathematical reasoning. In spite of extensive research, we still have a lot to explore for building robust representations of elementary math word problems and effective solutions for the general task. In this paper, we critically examine the various models that have been developed for solving word problems, their pros and cons and the challenges ahead. In the last 2 years, a lot of deep learning models have recorded competing results on benchmark datasets, making a critical and conceptual analysis of literature highly useful at this juncture. We take a step back and analyze why, in spite of this abundance in scholarly interest, the predominantly used experiment and dataset designs continue to be a stumbling block. From the vantage point of having analyzed the literature closely, we also endeavor to provide a road-map for future math word problem research. This article is categorized under: Technologies > Machine Learning Technologies > Artificial Intelligence Fundamental Concepts of Data and Knowledge > Knowledge Representation.

Keywords

    automated word problem, deep learning, natural language processing, solving

ASJC Scopus subject areas

Cite this

Does a language model “understand” high school math? A survey of deep learning based word problem solvers. / Sundaram, Sowmya S.; Gurajada, Sairam; Padmanabhan, Deepak et al.
In: Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery, 24.03.2024.

Research output: Contribution to journalReview articleResearchpeer review

Sundaram, SS, Gurajada, S, Padmanabhan, D, Abraham, SS & Fisichella, M 2024, 'Does a language model “understand” high school math? A survey of deep learning based word problem solvers', Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery. https://doi.org/10.1002/widm.1534
Sundaram, S. S., Gurajada, S., Padmanabhan, D., Abraham, S. S., & Fisichella, M. (2024). Does a language model “understand” high school math? A survey of deep learning based word problem solvers. Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery. Advance online publication. https://doi.org/10.1002/widm.1534
Sundaram SS, Gurajada S, Padmanabhan D, Abraham SS, Fisichella M. Does a language model “understand” high school math? A survey of deep learning based word problem solvers. Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery. 2024 Mar 24. Epub 2024 Mar 24. doi: 10.1002/widm.1534
Sundaram, Sowmya S. ; Gurajada, Sairam ; Padmanabhan, Deepak et al. / Does a language model “understand” high school math? A survey of deep learning based word problem solvers. In: Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery. 2024.
Download
@article{cf017daf25bd451a9539b601dad6fc92,
title = "Does a language model “understand” high school math? A survey of deep learning based word problem solvers",
abstract = "From the latter half of the last decade, there has been a growing interest in developing algorithms for automatically solving mathematical word problems (MWP). It is a challenging and unique task that demands blending surface level text pattern recognition with mathematical reasoning. In spite of extensive research, we still have a lot to explore for building robust representations of elementary math word problems and effective solutions for the general task. In this paper, we critically examine the various models that have been developed for solving word problems, their pros and cons and the challenges ahead. In the last 2 years, a lot of deep learning models have recorded competing results on benchmark datasets, making a critical and conceptual analysis of literature highly useful at this juncture. We take a step back and analyze why, in spite of this abundance in scholarly interest, the predominantly used experiment and dataset designs continue to be a stumbling block. From the vantage point of having analyzed the literature closely, we also endeavor to provide a road-map for future math word problem research. This article is categorized under: Technologies > Machine Learning Technologies > Artificial Intelligence Fundamental Concepts of Data and Knowledge > Knowledge Representation.",
keywords = "automated word problem, deep learning, natural language processing, solving",
author = "Sundaram, {Sowmya S.} and Sairam Gurajada and Deepak Padmanabhan and Abraham, {Savitha Sam} and Marco Fisichella",
note = "Funding Information: Open Access funding enabled and organized by Projekt DEAL",
year = "2024",
month = mar,
day = "24",
doi = "10.1002/widm.1534",
language = "English",

}

Download

TY - JOUR

T1 - Does a language model “understand” high school math? A survey of deep learning based word problem solvers

AU - Sundaram, Sowmya S.

AU - Gurajada, Sairam

AU - Padmanabhan, Deepak

AU - Abraham, Savitha Sam

AU - Fisichella, Marco

N1 - Funding Information: Open Access funding enabled and organized by Projekt DEAL

PY - 2024/3/24

Y1 - 2024/3/24

N2 - From the latter half of the last decade, there has been a growing interest in developing algorithms for automatically solving mathematical word problems (MWP). It is a challenging and unique task that demands blending surface level text pattern recognition with mathematical reasoning. In spite of extensive research, we still have a lot to explore for building robust representations of elementary math word problems and effective solutions for the general task. In this paper, we critically examine the various models that have been developed for solving word problems, their pros and cons and the challenges ahead. In the last 2 years, a lot of deep learning models have recorded competing results on benchmark datasets, making a critical and conceptual analysis of literature highly useful at this juncture. We take a step back and analyze why, in spite of this abundance in scholarly interest, the predominantly used experiment and dataset designs continue to be a stumbling block. From the vantage point of having analyzed the literature closely, we also endeavor to provide a road-map for future math word problem research. This article is categorized under: Technologies > Machine Learning Technologies > Artificial Intelligence Fundamental Concepts of Data and Knowledge > Knowledge Representation.

AB - From the latter half of the last decade, there has been a growing interest in developing algorithms for automatically solving mathematical word problems (MWP). It is a challenging and unique task that demands blending surface level text pattern recognition with mathematical reasoning. In spite of extensive research, we still have a lot to explore for building robust representations of elementary math word problems and effective solutions for the general task. In this paper, we critically examine the various models that have been developed for solving word problems, their pros and cons and the challenges ahead. In the last 2 years, a lot of deep learning models have recorded competing results on benchmark datasets, making a critical and conceptual analysis of literature highly useful at this juncture. We take a step back and analyze why, in spite of this abundance in scholarly interest, the predominantly used experiment and dataset designs continue to be a stumbling block. From the vantage point of having analyzed the literature closely, we also endeavor to provide a road-map for future math word problem research. This article is categorized under: Technologies > Machine Learning Technologies > Artificial Intelligence Fundamental Concepts of Data and Knowledge > Knowledge Representation.

KW - automated word problem

KW - deep learning

KW - natural language processing

KW - solving

UR - http://www.scopus.com/inward/record.url?scp=85189518550&partnerID=8YFLogxK

U2 - 10.1002/widm.1534

DO - 10.1002/widm.1534

M3 - Review article

AN - SCOPUS:85189518550

JO - Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery

JF - Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery

SN - 1942-4787

ER -

By the same author(s)