What is Needed to Apply Sentiment Analysis in Real Software Projects: A Feasibility Study in Industry

Research output: Chapter in book/report/conference proceedingConference contributionResearchpeer review

Authors

Research Organisations

View graph of relations

Details

Original languageEnglish
Title of host publicationHuman-Centered Software Engineering
Subtitle of host publication10th IFIP WG 13.2 International Working Conference, HCSE 2024, Proceedings
EditorsMarta Kristín Lárusdóttir, Bilal Naqvi, Regina Bernhaupt, Carmelo Ardito, Stefan Sauer
PublisherSpringer Science and Business Media Deutschland GmbH
Pages105-129
Number of pages25
ISBN (electronic)978-3-031-64576-1
ISBN (print)9783031645754
Publication statusPublished - 1 Jul 2024
Event10th IFIP WG 13.2 International Working Conference on Human-Centered Software Engineering, HCSE 2024 - Reykjavik, Finland
Duration: 8 Jul 202410 Jul 2024

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume14793 LNCS
ISSN (Print)0302-9743
ISSN (electronic)1611-3349

Abstract

Due to the increasing size of software projects, they usually require team work and a sufficient amount of communication, which can influence team mood. However, this communication is often not adequate by means of tone and language. Sentiment analysis tools can be used to prevent this problem by investigating the mood conveyed by text-based communication. Most studies aim to improve or develop sentiment analysis tools for a better prediction of the sentiments raised by a specific communication behavior. The tools were often tested in a small experimental group settings (e.g. academia or open-source), but only very few studies applied the tools in industrial software projects. In this paper, we focus on the feasibility and usefulness of a state-of-the-art sentiment analysis tool in industrial settings. We conducted a user study over 4 months, in which twelve practitioners used a sentiment analysis tool and received weekly information on the sentiments conveyed with their text-based communication in group chats. This way, we evaluated the general feasibility of sentiment analysis in industry. Afterwards, we conducted an interview study with six of the twelve participants to get feedback. This way, we validated the insights gained from the user study and evaluated whether the application of sentiment analysis is useful in industrial software projects. We also investigated which improvements are necessary in order to increase the usefulness of sentiment analysis. Every participant reported that such a tool is suited for the use in software projects. However, they also pointed out some improvements that are required to increase its usefulness. These improvements include explanations, dashboards, and sarcasm detection.

Keywords

    feasibility study, sentiment analysis, social aspects and behaviors, Software project

ASJC Scopus subject areas

Cite this

What is Needed to Apply Sentiment Analysis in Real Software Projects: A Feasibility Study in Industry. / Specht, Alexander; Obaidi, Martin; Nagel, Lukas et al.
Human-Centered Software Engineering : 10th IFIP WG 13.2 International Working Conference, HCSE 2024, Proceedings. ed. / Marta Kristín Lárusdóttir; Bilal Naqvi; Regina Bernhaupt; Carmelo Ardito; Stefan Sauer. Springer Science and Business Media Deutschland GmbH, 2024. p. 105-129 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 14793 LNCS).

Research output: Chapter in book/report/conference proceedingConference contributionResearchpeer review

Specht, A, Obaidi, M, Nagel, L, Stess, M & Klünder, J 2024, What is Needed to Apply Sentiment Analysis in Real Software Projects: A Feasibility Study in Industry. in MK Lárusdóttir, B Naqvi, R Bernhaupt, C Ardito & S Sauer (eds), Human-Centered Software Engineering : 10th IFIP WG 13.2 International Working Conference, HCSE 2024, Proceedings. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 14793 LNCS, Springer Science and Business Media Deutschland GmbH, pp. 105-129, 10th IFIP WG 13.2 International Working Conference on Human-Centered Software Engineering, HCSE 2024, Reykjavik, Finland, 8 Jul 2024. https://doi.org/10.1007/978-3-031-64576-1_6
Specht, A., Obaidi, M., Nagel, L., Stess, M., & Klünder, J. (2024). What is Needed to Apply Sentiment Analysis in Real Software Projects: A Feasibility Study in Industry. In M. K. Lárusdóttir, B. Naqvi, R. Bernhaupt, C. Ardito, & S. Sauer (Eds.), Human-Centered Software Engineering : 10th IFIP WG 13.2 International Working Conference, HCSE 2024, Proceedings (pp. 105-129). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 14793 LNCS). Springer Science and Business Media Deutschland GmbH. https://doi.org/10.1007/978-3-031-64576-1_6
Specht A, Obaidi M, Nagel L, Stess M, Klünder J. What is Needed to Apply Sentiment Analysis in Real Software Projects: A Feasibility Study in Industry. In Lárusdóttir MK, Naqvi B, Bernhaupt R, Ardito C, Sauer S, editors, Human-Centered Software Engineering : 10th IFIP WG 13.2 International Working Conference, HCSE 2024, Proceedings. Springer Science and Business Media Deutschland GmbH. 2024. p. 105-129. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). doi: 10.1007/978-3-031-64576-1_6
Specht, Alexander ; Obaidi, Martin ; Nagel, Lukas et al. / What is Needed to Apply Sentiment Analysis in Real Software Projects : A Feasibility Study in Industry. Human-Centered Software Engineering : 10th IFIP WG 13.2 International Working Conference, HCSE 2024, Proceedings. editor / Marta Kristín Lárusdóttir ; Bilal Naqvi ; Regina Bernhaupt ; Carmelo Ardito ; Stefan Sauer. Springer Science and Business Media Deutschland GmbH, 2024. pp. 105-129 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).
Download
@inproceedings{37adeeb17e8e4a408fc11c86e3fc8e9b,
title = "What is Needed to Apply Sentiment Analysis in Real Software Projects: A Feasibility Study in Industry",
abstract = "Due to the increasing size of software projects, they usually require team work and a sufficient amount of communication, which can influence team mood. However, this communication is often not adequate by means of tone and language. Sentiment analysis tools can be used to prevent this problem by investigating the mood conveyed by text-based communication. Most studies aim to improve or develop sentiment analysis tools for a better prediction of the sentiments raised by a specific communication behavior. The tools were often tested in a small experimental group settings (e.g. academia or open-source), but only very few studies applied the tools in industrial software projects. In this paper, we focus on the feasibility and usefulness of a state-of-the-art sentiment analysis tool in industrial settings. We conducted a user study over 4 months, in which twelve practitioners used a sentiment analysis tool and received weekly information on the sentiments conveyed with their text-based communication in group chats. This way, we evaluated the general feasibility of sentiment analysis in industry. Afterwards, we conducted an interview study with six of the twelve participants to get feedback. This way, we validated the insights gained from the user study and evaluated whether the application of sentiment analysis is useful in industrial software projects. We also investigated which improvements are necessary in order to increase the usefulness of sentiment analysis. Every participant reported that such a tool is suited for the use in software projects. However, they also pointed out some improvements that are required to increase its usefulness. These improvements include explanations, dashboards, and sarcasm detection.",
keywords = "feasibility study, sentiment analysis, social aspects and behaviors, Software project",
author = "Alexander Specht and Martin Obaidi and Lukas Nagel and Marek Stess and Jil Kl{\"u}nder",
note = "Publisher Copyright: {\textcopyright} IFIP International Federation for Information Processing 2024.; 10th IFIP WG 13.2 International Working Conference on Human-Centered Software Engineering, HCSE 2024 ; Conference date: 08-07-2024 Through 10-07-2024",
year = "2024",
month = jul,
day = "1",
doi = "10.1007/978-3-031-64576-1_6",
language = "English",
isbn = "9783031645754",
series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
publisher = "Springer Science and Business Media Deutschland GmbH",
pages = "105--129",
editor = "L{\'a}rusd{\'o}ttir, {Marta Krist{\'i}n} and Bilal Naqvi and Regina Bernhaupt and Carmelo Ardito and Stefan Sauer",
booktitle = "Human-Centered Software Engineering",
address = "Germany",

}

Download

TY - GEN

T1 - What is Needed to Apply Sentiment Analysis in Real Software Projects

T2 - 10th IFIP WG 13.2 International Working Conference on Human-Centered Software Engineering, HCSE 2024

AU - Specht, Alexander

AU - Obaidi, Martin

AU - Nagel, Lukas

AU - Stess, Marek

AU - Klünder, Jil

N1 - Publisher Copyright: © IFIP International Federation for Information Processing 2024.

PY - 2024/7/1

Y1 - 2024/7/1

N2 - Due to the increasing size of software projects, they usually require team work and a sufficient amount of communication, which can influence team mood. However, this communication is often not adequate by means of tone and language. Sentiment analysis tools can be used to prevent this problem by investigating the mood conveyed by text-based communication. Most studies aim to improve or develop sentiment analysis tools for a better prediction of the sentiments raised by a specific communication behavior. The tools were often tested in a small experimental group settings (e.g. academia or open-source), but only very few studies applied the tools in industrial software projects. In this paper, we focus on the feasibility and usefulness of a state-of-the-art sentiment analysis tool in industrial settings. We conducted a user study over 4 months, in which twelve practitioners used a sentiment analysis tool and received weekly information on the sentiments conveyed with their text-based communication in group chats. This way, we evaluated the general feasibility of sentiment analysis in industry. Afterwards, we conducted an interview study with six of the twelve participants to get feedback. This way, we validated the insights gained from the user study and evaluated whether the application of sentiment analysis is useful in industrial software projects. We also investigated which improvements are necessary in order to increase the usefulness of sentiment analysis. Every participant reported that such a tool is suited for the use in software projects. However, they also pointed out some improvements that are required to increase its usefulness. These improvements include explanations, dashboards, and sarcasm detection.

AB - Due to the increasing size of software projects, they usually require team work and a sufficient amount of communication, which can influence team mood. However, this communication is often not adequate by means of tone and language. Sentiment analysis tools can be used to prevent this problem by investigating the mood conveyed by text-based communication. Most studies aim to improve or develop sentiment analysis tools for a better prediction of the sentiments raised by a specific communication behavior. The tools were often tested in a small experimental group settings (e.g. academia or open-source), but only very few studies applied the tools in industrial software projects. In this paper, we focus on the feasibility and usefulness of a state-of-the-art sentiment analysis tool in industrial settings. We conducted a user study over 4 months, in which twelve practitioners used a sentiment analysis tool and received weekly information on the sentiments conveyed with their text-based communication in group chats. This way, we evaluated the general feasibility of sentiment analysis in industry. Afterwards, we conducted an interview study with six of the twelve participants to get feedback. This way, we validated the insights gained from the user study and evaluated whether the application of sentiment analysis is useful in industrial software projects. We also investigated which improvements are necessary in order to increase the usefulness of sentiment analysis. Every participant reported that such a tool is suited for the use in software projects. However, they also pointed out some improvements that are required to increase its usefulness. These improvements include explanations, dashboards, and sarcasm detection.

KW - feasibility study

KW - sentiment analysis

KW - social aspects and behaviors

KW - Software project

UR - http://www.scopus.com/inward/record.url?scp=85200201955&partnerID=8YFLogxK

U2 - 10.1007/978-3-031-64576-1_6

DO - 10.1007/978-3-031-64576-1_6

M3 - Conference contribution

AN - SCOPUS:85200201955

SN - 9783031645754

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 105

EP - 129

BT - Human-Centered Software Engineering

A2 - Lárusdóttir, Marta Kristín

A2 - Naqvi, Bilal

A2 - Bernhaupt, Regina

A2 - Ardito, Carmelo

A2 - Sauer, Stefan

PB - Springer Science and Business Media Deutschland GmbH

Y2 - 8 July 2024 through 10 July 2024

ER -

By the same author(s)