What is Needed to Apply Sentiment Analysis in Real Software Projects: A Feasibility Study in Industry

Publikation: Beitrag in Buch/Bericht/Sammelwerk/KonferenzbandAufsatz in KonferenzbandForschungPeer-Review

Autoren

Organisationseinheiten

Forschungs-netzwerk anzeigen

Details

OriginalspracheEnglisch
Titel des SammelwerksHuman-Centered Software Engineering
Untertitel10th IFIP WG 13.2 International Working Conference, HCSE 2024, Proceedings
Herausgeber/-innenMarta Kristín Lárusdóttir, Bilal Naqvi, Regina Bernhaupt, Carmelo Ardito, Stefan Sauer
Herausgeber (Verlag)Springer Science and Business Media Deutschland GmbH
Seiten105-129
Seitenumfang25
ISBN (elektronisch)978-3-031-64576-1
ISBN (Print)9783031645754
PublikationsstatusVeröffentlicht - 1 Juli 2024
Veranstaltung10th IFIP WG 13.2 International Working Conference on Human-Centered Software Engineering, HCSE 2024 - Reykjavik, Finnland
Dauer: 8 Juli 202410 Juli 2024

Publikationsreihe

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Band14793 LNCS
ISSN (Print)0302-9743
ISSN (elektronisch)1611-3349

Abstract

Due to the increasing size of software projects, they usually require team work and a sufficient amount of communication, which can influence team mood. However, this communication is often not adequate by means of tone and language. Sentiment analysis tools can be used to prevent this problem by investigating the mood conveyed by text-based communication. Most studies aim to improve or develop sentiment analysis tools for a better prediction of the sentiments raised by a specific communication behavior. The tools were often tested in a small experimental group settings (e.g. academia or open-source), but only very few studies applied the tools in industrial software projects. In this paper, we focus on the feasibility and usefulness of a state-of-the-art sentiment analysis tool in industrial settings. We conducted a user study over 4 months, in which twelve practitioners used a sentiment analysis tool and received weekly information on the sentiments conveyed with their text-based communication in group chats. This way, we evaluated the general feasibility of sentiment analysis in industry. Afterwards, we conducted an interview study with six of the twelve participants to get feedback. This way, we validated the insights gained from the user study and evaluated whether the application of sentiment analysis is useful in industrial software projects. We also investigated which improvements are necessary in order to increase the usefulness of sentiment analysis. Every participant reported that such a tool is suited for the use in software projects. However, they also pointed out some improvements that are required to increase its usefulness. These improvements include explanations, dashboards, and sarcasm detection.

ASJC Scopus Sachgebiete

Zitieren

What is Needed to Apply Sentiment Analysis in Real Software Projects: A Feasibility Study in Industry. / Specht, Alexander; Obaidi, Martin; Nagel, Lukas et al.
Human-Centered Software Engineering : 10th IFIP WG 13.2 International Working Conference, HCSE 2024, Proceedings. Hrsg. / Marta Kristín Lárusdóttir; Bilal Naqvi; Regina Bernhaupt; Carmelo Ardito; Stefan Sauer. Springer Science and Business Media Deutschland GmbH, 2024. S. 105-129 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Band 14793 LNCS).

Publikation: Beitrag in Buch/Bericht/Sammelwerk/KonferenzbandAufsatz in KonferenzbandForschungPeer-Review

Specht, A, Obaidi, M, Nagel, L, Stess, M & Klünder, J 2024, What is Needed to Apply Sentiment Analysis in Real Software Projects: A Feasibility Study in Industry. in MK Lárusdóttir, B Naqvi, R Bernhaupt, C Ardito & S Sauer (Hrsg.), Human-Centered Software Engineering : 10th IFIP WG 13.2 International Working Conference, HCSE 2024, Proceedings. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), Bd. 14793 LNCS, Springer Science and Business Media Deutschland GmbH, S. 105-129, 10th IFIP WG 13.2 International Working Conference on Human-Centered Software Engineering, HCSE 2024, Reykjavik, Finnland, 8 Juli 2024. https://doi.org/10.1007/978-3-031-64576-1_6
Specht, A., Obaidi, M., Nagel, L., Stess, M., & Klünder, J. (2024). What is Needed to Apply Sentiment Analysis in Real Software Projects: A Feasibility Study in Industry. In M. K. Lárusdóttir, B. Naqvi, R. Bernhaupt, C. Ardito, & S. Sauer (Hrsg.), Human-Centered Software Engineering : 10th IFIP WG 13.2 International Working Conference, HCSE 2024, Proceedings (S. 105-129). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Band 14793 LNCS). Springer Science and Business Media Deutschland GmbH. https://doi.org/10.1007/978-3-031-64576-1_6
Specht A, Obaidi M, Nagel L, Stess M, Klünder J. What is Needed to Apply Sentiment Analysis in Real Software Projects: A Feasibility Study in Industry. in Lárusdóttir MK, Naqvi B, Bernhaupt R, Ardito C, Sauer S, Hrsg., Human-Centered Software Engineering : 10th IFIP WG 13.2 International Working Conference, HCSE 2024, Proceedings. Springer Science and Business Media Deutschland GmbH. 2024. S. 105-129. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). doi: 10.1007/978-3-031-64576-1_6
Specht, Alexander ; Obaidi, Martin ; Nagel, Lukas et al. / What is Needed to Apply Sentiment Analysis in Real Software Projects : A Feasibility Study in Industry. Human-Centered Software Engineering : 10th IFIP WG 13.2 International Working Conference, HCSE 2024, Proceedings. Hrsg. / Marta Kristín Lárusdóttir ; Bilal Naqvi ; Regina Bernhaupt ; Carmelo Ardito ; Stefan Sauer. Springer Science and Business Media Deutschland GmbH, 2024. S. 105-129 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).
Download
@inproceedings{37adeeb17e8e4a408fc11c86e3fc8e9b,
title = "What is Needed to Apply Sentiment Analysis in Real Software Projects: A Feasibility Study in Industry",
abstract = "Due to the increasing size of software projects, they usually require team work and a sufficient amount of communication, which can influence team mood. However, this communication is often not adequate by means of tone and language. Sentiment analysis tools can be used to prevent this problem by investigating the mood conveyed by text-based communication. Most studies aim to improve or develop sentiment analysis tools for a better prediction of the sentiments raised by a specific communication behavior. The tools were often tested in a small experimental group settings (e.g. academia or open-source), but only very few studies applied the tools in industrial software projects. In this paper, we focus on the feasibility and usefulness of a state-of-the-art sentiment analysis tool in industrial settings. We conducted a user study over 4 months, in which twelve practitioners used a sentiment analysis tool and received weekly information on the sentiments conveyed with their text-based communication in group chats. This way, we evaluated the general feasibility of sentiment analysis in industry. Afterwards, we conducted an interview study with six of the twelve participants to get feedback. This way, we validated the insights gained from the user study and evaluated whether the application of sentiment analysis is useful in industrial software projects. We also investigated which improvements are necessary in order to increase the usefulness of sentiment analysis. Every participant reported that such a tool is suited for the use in software projects. However, they also pointed out some improvements that are required to increase its usefulness. These improvements include explanations, dashboards, and sarcasm detection.",
keywords = "feasibility study, sentiment analysis, social aspects and behaviors, Software project",
author = "Alexander Specht and Martin Obaidi and Lukas Nagel and Marek Stess and Jil Kl{\"u}nder",
note = "Publisher Copyright: {\textcopyright} IFIP International Federation for Information Processing 2024.; 10th IFIP WG 13.2 International Working Conference on Human-Centered Software Engineering, HCSE 2024 ; Conference date: 08-07-2024 Through 10-07-2024",
year = "2024",
month = jul,
day = "1",
doi = "10.1007/978-3-031-64576-1_6",
language = "English",
isbn = "9783031645754",
series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
publisher = "Springer Science and Business Media Deutschland GmbH",
pages = "105--129",
editor = "L{\'a}rusd{\'o}ttir, {Marta Krist{\'i}n} and Bilal Naqvi and Regina Bernhaupt and Carmelo Ardito and Stefan Sauer",
booktitle = "Human-Centered Software Engineering",
address = "Germany",

}

Download

TY - GEN

T1 - What is Needed to Apply Sentiment Analysis in Real Software Projects

T2 - 10th IFIP WG 13.2 International Working Conference on Human-Centered Software Engineering, HCSE 2024

AU - Specht, Alexander

AU - Obaidi, Martin

AU - Nagel, Lukas

AU - Stess, Marek

AU - Klünder, Jil

N1 - Publisher Copyright: © IFIP International Federation for Information Processing 2024.

PY - 2024/7/1

Y1 - 2024/7/1

N2 - Due to the increasing size of software projects, they usually require team work and a sufficient amount of communication, which can influence team mood. However, this communication is often not adequate by means of tone and language. Sentiment analysis tools can be used to prevent this problem by investigating the mood conveyed by text-based communication. Most studies aim to improve or develop sentiment analysis tools for a better prediction of the sentiments raised by a specific communication behavior. The tools were often tested in a small experimental group settings (e.g. academia or open-source), but only very few studies applied the tools in industrial software projects. In this paper, we focus on the feasibility and usefulness of a state-of-the-art sentiment analysis tool in industrial settings. We conducted a user study over 4 months, in which twelve practitioners used a sentiment analysis tool and received weekly information on the sentiments conveyed with their text-based communication in group chats. This way, we evaluated the general feasibility of sentiment analysis in industry. Afterwards, we conducted an interview study with six of the twelve participants to get feedback. This way, we validated the insights gained from the user study and evaluated whether the application of sentiment analysis is useful in industrial software projects. We also investigated which improvements are necessary in order to increase the usefulness of sentiment analysis. Every participant reported that such a tool is suited for the use in software projects. However, they also pointed out some improvements that are required to increase its usefulness. These improvements include explanations, dashboards, and sarcasm detection.

AB - Due to the increasing size of software projects, they usually require team work and a sufficient amount of communication, which can influence team mood. However, this communication is often not adequate by means of tone and language. Sentiment analysis tools can be used to prevent this problem by investigating the mood conveyed by text-based communication. Most studies aim to improve or develop sentiment analysis tools for a better prediction of the sentiments raised by a specific communication behavior. The tools were often tested in a small experimental group settings (e.g. academia or open-source), but only very few studies applied the tools in industrial software projects. In this paper, we focus on the feasibility and usefulness of a state-of-the-art sentiment analysis tool in industrial settings. We conducted a user study over 4 months, in which twelve practitioners used a sentiment analysis tool and received weekly information on the sentiments conveyed with their text-based communication in group chats. This way, we evaluated the general feasibility of sentiment analysis in industry. Afterwards, we conducted an interview study with six of the twelve participants to get feedback. This way, we validated the insights gained from the user study and evaluated whether the application of sentiment analysis is useful in industrial software projects. We also investigated which improvements are necessary in order to increase the usefulness of sentiment analysis. Every participant reported that such a tool is suited for the use in software projects. However, they also pointed out some improvements that are required to increase its usefulness. These improvements include explanations, dashboards, and sarcasm detection.

KW - feasibility study

KW - sentiment analysis

KW - social aspects and behaviors

KW - Software project

UR - http://www.scopus.com/inward/record.url?scp=85200201955&partnerID=8YFLogxK

U2 - 10.1007/978-3-031-64576-1_6

DO - 10.1007/978-3-031-64576-1_6

M3 - Conference contribution

AN - SCOPUS:85200201955

SN - 9783031645754

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 105

EP - 129

BT - Human-Centered Software Engineering

A2 - Lárusdóttir, Marta Kristín

A2 - Naqvi, Bilal

A2 - Bernhaupt, Regina

A2 - Ardito, Carmelo

A2 - Sauer, Stefan

PB - Springer Science and Business Media Deutschland GmbH

Y2 - 8 July 2024 through 10 July 2024

ER -

Von denselben Autoren