Loading [MathJax]/jax/input/TeX/config.js

The effects on adaptive behaviour of negatively valenced signals in reinforcement learning

Publikation: Beitrag in Buch/Bericht/Sammelwerk/KonferenzbandAufsatz in KonferenzbandForschungPeer-Review

Autorschaft

Externe Organisationen

  • Universität Hamburg
  • Göteborgs Universitet
Plum Print visual indicator of research metrics
  • Citations
    • Citation Indexes: 6
  • Captures
    • Readers: 15
see details

Details

OriginalspracheEnglisch
Titel des Sammelwerks7th Joint IEEE International Conference on Development and Learning and on Epigenetic Robotics, ICDL-EpiRob 2017
Herausgeber (Verlag)Institute of Electrical and Electronics Engineers Inc.
Seiten148-155
Seitenumfang8
ISBN (elektronisch)9781538637159
PublikationsstatusVeröffentlicht - 2 Juli 2017
Extern publiziertJa
Veranstaltung7th Joint IEEE International Conference on Development and Learning and on Epigenetic Robotics, ICDL-EpiRob 2017 - Lisbon, Portugal
Dauer: 18 Sept. 201721 Sept. 2017

Abstract

Reinforcement learning algorithms and particularly those based on temporal-difference learning are widely adopted and have been successfully applied to a number of problems as well as used to model animal learning. However, they are based on neural pathways involved in reward-seeking behaviour since little is known about punishment-driven learning and less still about the combined effects of both types of reinforcement on learning. This may not only be a shortcoming for computational models of human and animal learning but we have recently shown that it may also carry detrimental effects for machine learning applications, with respect to task performance and convergence speed. Here, we further explore our original results and compare the effects of different functions, i.e. binary, linear, exponential with different variance, for punishment on learning. Our experiments confirm the original finding of punishment signals reducing learning speed. It appears this result generalizes across a number of different functions of punishment reinforcement.

ASJC Scopus Sachgebiete

Zitieren

The effects on adaptive behaviour of negatively valenced signals in reinforcement learning. / Navarro-Guerrero, Nicolas; Lowe, Robert J.; Wermter, Stefan.
7th Joint IEEE International Conference on Development and Learning and on Epigenetic Robotics, ICDL-EpiRob 2017. Institute of Electrical and Electronics Engineers Inc., 2017. S. 148-155.

Publikation: Beitrag in Buch/Bericht/Sammelwerk/KonferenzbandAufsatz in KonferenzbandForschungPeer-Review

Navarro-Guerrero, N, Lowe, RJ & Wermter, S 2017, The effects on adaptive behaviour of negatively valenced signals in reinforcement learning. in 7th Joint IEEE International Conference on Development and Learning and on Epigenetic Robotics, ICDL-EpiRob 2017. Institute of Electrical and Electronics Engineers Inc., S. 148-155, 7th Joint IEEE International Conference on Development and Learning and on Epigenetic Robotics, ICDL-EpiRob 2017, Lisbon, Portugal, 18 Sept. 2017. https://doi.org/10.1109/devlrn.2017.8329800
Navarro-Guerrero, N., Lowe, R. J., & Wermter, S. (2017). The effects on adaptive behaviour of negatively valenced signals in reinforcement learning. In 7th Joint IEEE International Conference on Development and Learning and on Epigenetic Robotics, ICDL-EpiRob 2017 (S. 148-155). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/devlrn.2017.8329800
Navarro-Guerrero N, Lowe RJ, Wermter S. The effects on adaptive behaviour of negatively valenced signals in reinforcement learning. in 7th Joint IEEE International Conference on Development and Learning and on Epigenetic Robotics, ICDL-EpiRob 2017. Institute of Electrical and Electronics Engineers Inc. 2017. S. 148-155 doi: 10.1109/devlrn.2017.8329800
Navarro-Guerrero, Nicolas ; Lowe, Robert J. ; Wermter, Stefan. / The effects on adaptive behaviour of negatively valenced signals in reinforcement learning. 7th Joint IEEE International Conference on Development and Learning and on Epigenetic Robotics, ICDL-EpiRob 2017. Institute of Electrical and Electronics Engineers Inc., 2017. S. 148-155
Download
@inproceedings{2116921fa5e444d0a3afbdc33875394d,
title = "The effects on adaptive behaviour of negatively valenced signals in reinforcement learning",
abstract = "Reinforcement learning algorithms and particularly those based on temporal-difference learning are widely adopted and have been successfully applied to a number of problems as well as used to model animal learning. However, they are based on neural pathways involved in reward-seeking behaviour since little is known about punishment-driven learning and less still about the combined effects of both types of reinforcement on learning. This may not only be a shortcoming for computational models of human and animal learning but we have recently shown that it may also carry detrimental effects for machine learning applications, with respect to task performance and convergence speed. Here, we further explore our original results and compare the effects of different functions, i.e. binary, linear, exponential with different variance, for punishment on learning. Our experiments confirm the original finding of punishment signals reducing learning speed. It appears this result generalizes across a number of different functions of punishment reinforcement.",
author = "Nicolas Navarro-Guerrero and Lowe, {Robert J.} and Stefan Wermter",
note = "Publisher Copyright: {\textcopyright} 2017 IEEE.; 7th Joint IEEE International Conference on Development and Learning and on Epigenetic Robotics, ICDL-EpiRob 2017 ; Conference date: 18-09-2017 Through 21-09-2017",
year = "2017",
month = jul,
day = "2",
doi = "10.1109/devlrn.2017.8329800",
language = "English",
pages = "148--155",
booktitle = "7th Joint IEEE International Conference on Development and Learning and on Epigenetic Robotics, ICDL-EpiRob 2017",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
address = "United States",

}

Download

TY - GEN

T1 - The effects on adaptive behaviour of negatively valenced signals in reinforcement learning

AU - Navarro-Guerrero, Nicolas

AU - Lowe, Robert J.

AU - Wermter, Stefan

N1 - Publisher Copyright: © 2017 IEEE.

PY - 2017/7/2

Y1 - 2017/7/2

N2 - Reinforcement learning algorithms and particularly those based on temporal-difference learning are widely adopted and have been successfully applied to a number of problems as well as used to model animal learning. However, they are based on neural pathways involved in reward-seeking behaviour since little is known about punishment-driven learning and less still about the combined effects of both types of reinforcement on learning. This may not only be a shortcoming for computational models of human and animal learning but we have recently shown that it may also carry detrimental effects for machine learning applications, with respect to task performance and convergence speed. Here, we further explore our original results and compare the effects of different functions, i.e. binary, linear, exponential with different variance, for punishment on learning. Our experiments confirm the original finding of punishment signals reducing learning speed. It appears this result generalizes across a number of different functions of punishment reinforcement.

AB - Reinforcement learning algorithms and particularly those based on temporal-difference learning are widely adopted and have been successfully applied to a number of problems as well as used to model animal learning. However, they are based on neural pathways involved in reward-seeking behaviour since little is known about punishment-driven learning and less still about the combined effects of both types of reinforcement on learning. This may not only be a shortcoming for computational models of human and animal learning but we have recently shown that it may also carry detrimental effects for machine learning applications, with respect to task performance and convergence speed. Here, we further explore our original results and compare the effects of different functions, i.e. binary, linear, exponential with different variance, for punishment on learning. Our experiments confirm the original finding of punishment signals reducing learning speed. It appears this result generalizes across a number of different functions of punishment reinforcement.

UR - http://www.scopus.com/inward/record.url?scp=85050366417&partnerID=8YFLogxK

U2 - 10.1109/devlrn.2017.8329800

DO - 10.1109/devlrn.2017.8329800

M3 - Conference contribution

AN - SCOPUS:85050366417

SP - 148

EP - 155

BT - 7th Joint IEEE International Conference on Development and Learning and on Epigenetic Robotics, ICDL-EpiRob 2017

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 7th Joint IEEE International Conference on Development and Learning and on Epigenetic Robotics, ICDL-EpiRob 2017

Y2 - 18 September 2017 through 21 September 2017

ER -

Von denselben Autoren