Loading [MathJax]/extensions/tex2jax.js

Non-Autoregressive vs Autoregressive Neural Networks for System Identification

Publikation: Beitrag in Buch/Bericht/Sammelwerk/KonferenzbandAufsatz in KonferenzbandForschungPeer-Review

Autorschaft

Externe Organisationen

  • Technische Universität Berlin

Details

OriginalspracheEnglisch
Titel des SammelwerksProceedings - IFAC-PapersOnLine
Seiten692-698
Seitenumfang7
Band54
Auflage20
PublikationsstatusVeröffentlicht - 2021
Extern publiziertJa

Publikationsreihe

NameIFAC-PapersOnLine
Herausgeber (Verlag)IFAC Secretariat
ISSN (Print)2405-8963

Abstract

The application of neural networks to non-linear dynamic system identification tasks has a long history, which consists mostly of autoregressive approaches. Autoregression, the usage of the model outputs of previous time steps, is a method of transferring a system state between time steps, which is not necessary for modeling dynamic systems with modern neural network structures, such as gated recurrent units (GRUs) and Temporal Convolutional Networks (TCNs). We compare the accuracy and execution performance of autoregressive and non-autoregressive implementations of a GRU and TCN on the simulation task of three publicly available system identification benchmarks. Our results show, that the non-autoregressive neural networks are significantly faster and at least as accurate as their autoregressive counterparts. Comparisons with other state-of-the-art black-box system identification methods show, that our implementation of the non-autoregressive GRU is the best performing neural network-based system identification method, and in the benchmarks without extrapolation, the best performing black-box method.

ASJC Scopus Sachgebiete

Zitieren

Non-Autoregressive vs Autoregressive Neural Networks for System Identification. / Weber, Daniel; Gühmann, Clemens.
Proceedings - IFAC-PapersOnLine. Band 54 20. Aufl. 2021. S. 692-698 (IFAC-PapersOnLine).

Publikation: Beitrag in Buch/Bericht/Sammelwerk/KonferenzbandAufsatz in KonferenzbandForschungPeer-Review

Weber, D., & Gühmann, C. (2021). Non-Autoregressive vs Autoregressive Neural Networks for System Identification. In Proceedings - IFAC-PapersOnLine (20 Aufl., Band 54, S. 692-698). (IFAC-PapersOnLine). https://doi.org/10.1016/j.ifacol.2021.11.252, https://doi.org/10.48550/arXiv.2105.02027
Weber D, Gühmann C. Non-Autoregressive vs Autoregressive Neural Networks for System Identification. in Proceedings - IFAC-PapersOnLine. 20 Aufl. Band 54. 2021. S. 692-698. (IFAC-PapersOnLine). doi: 10.1016/j.ifacol.2021.11.252, 10.48550/arXiv.2105.02027
Weber, Daniel ; Gühmann, Clemens. / Non-Autoregressive vs Autoregressive Neural Networks for System Identification. Proceedings - IFAC-PapersOnLine. Band 54 20. Aufl. 2021. S. 692-698 (IFAC-PapersOnLine).
Download
@inproceedings{46e573ec2a5d44e0b76b341e57d23732,
title = "Non-Autoregressive vs Autoregressive Neural Networks for System Identification",
abstract = "The application of neural networks to non-linear dynamic system identification tasks has a long history, which consists mostly of autoregressive approaches. Autoregression, the usage of the model outputs of previous time steps, is a method of transferring a system state between time steps, which is not necessary for modeling dynamic systems with modern neural network structures, such as gated recurrent units (GRUs) and Temporal Convolutional Networks (TCNs). We compare the accuracy and execution performance of autoregressive and non-autoregressive implementations of a GRU and TCN on the simulation task of three publicly available system identification benchmarks. Our results show, that the non-autoregressive neural networks are significantly faster and at least as accurate as their autoregressive counterparts. Comparisons with other state-of-the-art black-box system identification methods show, that our implementation of the non-autoregressive GRU is the best performing neural network-based system identification method, and in the benchmarks without extrapolation, the best performing black-box method.",
keywords = "Benchmark Systems, Gated Recurrent Unit, Neural Networks, Nonlinear System Identification, Process Noise, Temporal Convolutional Network, Wiener-Hammerstein",
author = "Daniel Weber and Clemens G{\"u}hmann",
note = "Publisher Copyright: Copyright {\textcopyright} 2021 The Authors. This is an open access article under the CC BY-NC-ND license (https://creativecommons.org/licenses/by-nc-nd/4.0/)",
year = "2021",
doi = "10.1016/j.ifacol.2021.11.252",
language = "English",
volume = "54",
series = "IFAC-PapersOnLine",
publisher = "IFAC Secretariat",
pages = "692--698",
booktitle = "Proceedings - IFAC-PapersOnLine",
edition = "20",

}

Download

TY - GEN

T1 - Non-Autoregressive vs Autoregressive Neural Networks for System Identification

AU - Weber, Daniel

AU - Gühmann, Clemens

N1 - Publisher Copyright: Copyright © 2021 The Authors. This is an open access article under the CC BY-NC-ND license (https://creativecommons.org/licenses/by-nc-nd/4.0/)

PY - 2021

Y1 - 2021

N2 - The application of neural networks to non-linear dynamic system identification tasks has a long history, which consists mostly of autoregressive approaches. Autoregression, the usage of the model outputs of previous time steps, is a method of transferring a system state between time steps, which is not necessary for modeling dynamic systems with modern neural network structures, such as gated recurrent units (GRUs) and Temporal Convolutional Networks (TCNs). We compare the accuracy and execution performance of autoregressive and non-autoregressive implementations of a GRU and TCN on the simulation task of three publicly available system identification benchmarks. Our results show, that the non-autoregressive neural networks are significantly faster and at least as accurate as their autoregressive counterparts. Comparisons with other state-of-the-art black-box system identification methods show, that our implementation of the non-autoregressive GRU is the best performing neural network-based system identification method, and in the benchmarks without extrapolation, the best performing black-box method.

AB - The application of neural networks to non-linear dynamic system identification tasks has a long history, which consists mostly of autoregressive approaches. Autoregression, the usage of the model outputs of previous time steps, is a method of transferring a system state between time steps, which is not necessary for modeling dynamic systems with modern neural network structures, such as gated recurrent units (GRUs) and Temporal Convolutional Networks (TCNs). We compare the accuracy and execution performance of autoregressive and non-autoregressive implementations of a GRU and TCN on the simulation task of three publicly available system identification benchmarks. Our results show, that the non-autoregressive neural networks are significantly faster and at least as accurate as their autoregressive counterparts. Comparisons with other state-of-the-art black-box system identification methods show, that our implementation of the non-autoregressive GRU is the best performing neural network-based system identification method, and in the benchmarks without extrapolation, the best performing black-box method.

KW - Benchmark Systems

KW - Gated Recurrent Unit

KW - Neural Networks

KW - Nonlinear System Identification

KW - Process Noise

KW - Temporal Convolutional Network

KW - Wiener-Hammerstein

UR - http://www.scopus.com/inward/record.url?scp=85124626242&partnerID=8YFLogxK

U2 - 10.1016/j.ifacol.2021.11.252

DO - 10.1016/j.ifacol.2021.11.252

M3 - Conference contribution

VL - 54

T3 - IFAC-PapersOnLine

SP - 692

EP - 698

BT - Proceedings - IFAC-PapersOnLine

ER -

Von denselben Autoren