MCENET: Multi-Context Encoder Network for Homogeneous Agent Trajectory Prediction in Mixed Traffic

Research output: Chapter in book/report/conference proceedingConference contributionResearchpeer review

Authors

  • Hao Cheng
  • Wentong Liao
  • Michael Ying Yang
  • Monika Sester
  • Bodo Rosenhahn

External Research Organisations

  • University of Twente
View graph of relations

Details

Original languageEnglish
Title of host publication2020 IEEE 23rd International Conference on Intelligent Transportation Systems, ITSC 2020
PublisherInstitute of Electrical and Electronics Engineers Inc.
Number of pages9
ISBN (electronic)978-1-7281-4149-7
ISBN (print)978-1-7281-4150-3
Publication statusPublished - 2020

Abstract

Trajectory prediction in urban mixed-traffic zones (a.k. a. shared spaces) is critical for many intelligent transportation systems, such as intent detection for autonomous driving. However, there are many challenges to predict the trajectories of heterogeneous road agents (pedestrians, cyclists and vehicles) at a microscopical level. For example, an agent might be able to choose multiple plausible paths in complex interactions with other agents in varying environments. To this end, we propose an approach named Multi-Context Encoder Network (MCENET) that is trained by encoding both past and future scene context, interaction context and motion information to capture the patterns and variations of the future trajectories using a set of stochastic latent variables. In inference time, we combine the past context and motion information of the target agent with samplings of the latent variables to predict multiple realistic trajectories in the future. Through experiments on several datasets of varying scenes, our method outperforms some of the recent state-of-the-art methods for mixed traffic trajectory prediction by a large margin and more robust in a very challenging environment. The impact of each context is justified via ablation studies.

Keywords

    cs.CV, cs.CY, cs.MA

ASJC Scopus subject areas

Sustainable Development Goals

Cite this

MCENET: Multi-Context Encoder Network for Homogeneous Agent Trajectory Prediction in Mixed Traffic. / Cheng, Hao; Liao, Wentong; Yang, Michael Ying et al.
2020 IEEE 23rd International Conference on Intelligent Transportation Systems, ITSC 2020. Institute of Electrical and Electronics Engineers Inc., 2020. 9294296.

Research output: Chapter in book/report/conference proceedingConference contributionResearchpeer review

Cheng, H, Liao, W, Yang, MY, Sester, M & Rosenhahn, B 2020, MCENET: Multi-Context Encoder Network for Homogeneous Agent Trajectory Prediction in Mixed Traffic. in 2020 IEEE 23rd International Conference on Intelligent Transportation Systems, ITSC 2020., 9294296, Institute of Electrical and Electronics Engineers Inc. https://doi.org/10.1109/ITSC45102.2020.9294296
Cheng, H., Liao, W., Yang, M. Y., Sester, M., & Rosenhahn, B. (2020). MCENET: Multi-Context Encoder Network for Homogeneous Agent Trajectory Prediction in Mixed Traffic. In 2020 IEEE 23rd International Conference on Intelligent Transportation Systems, ITSC 2020 Article 9294296 Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ITSC45102.2020.9294296
Cheng H, Liao W, Yang MY, Sester M, Rosenhahn B. MCENET: Multi-Context Encoder Network for Homogeneous Agent Trajectory Prediction in Mixed Traffic. In 2020 IEEE 23rd International Conference on Intelligent Transportation Systems, ITSC 2020. Institute of Electrical and Electronics Engineers Inc. 2020. 9294296 doi: 10.1109/ITSC45102.2020.9294296
Cheng, Hao ; Liao, Wentong ; Yang, Michael Ying et al. / MCENET : Multi-Context Encoder Network for Homogeneous Agent Trajectory Prediction in Mixed Traffic. 2020 IEEE 23rd International Conference on Intelligent Transportation Systems, ITSC 2020. Institute of Electrical and Electronics Engineers Inc., 2020.
Download
@inproceedings{8365fd2dfdb04ea2b63bbbf1c5e90ca3,
title = "MCENET: Multi-Context Encoder Network for Homogeneous Agent Trajectory Prediction in Mixed Traffic",
abstract = "Trajectory prediction in urban mixed-traffic zones (a.k. a. shared spaces) is critical for many intelligent transportation systems, such as intent detection for autonomous driving. However, there are many challenges to predict the trajectories of heterogeneous road agents (pedestrians, cyclists and vehicles) at a microscopical level. For example, an agent might be able to choose multiple plausible paths in complex interactions with other agents in varying environments. To this end, we propose an approach named Multi-Context Encoder Network (MCENET) that is trained by encoding both past and future scene context, interaction context and motion information to capture the patterns and variations of the future trajectories using a set of stochastic latent variables. In inference time, we combine the past context and motion information of the target agent with samplings of the latent variables to predict multiple realistic trajectories in the future. Through experiments on several datasets of varying scenes, our method outperforms some of the recent state-of-the-art methods for mixed traffic trajectory prediction by a large margin and more robust in a very challenging environment. The impact of each context is justified via ablation studies.",
keywords = "cs.CV, cs.CY, cs.MA",
author = "Hao Cheng and Wentong Liao and Yang, {Michael Ying} and Monika Sester and Bodo Rosenhahn",
note = "Funding Information: This work is supported by the German Research Founda- tion (DFG) through the Research Training Group SocialCars (GRK 1931) and grants COVMAP (RO 2497/12-2).",
year = "2020",
doi = "10.1109/ITSC45102.2020.9294296",
language = "English",
isbn = "978-1-7281-4150-3",
booktitle = "2020 IEEE 23rd International Conference on Intelligent Transportation Systems, ITSC 2020",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
address = "United States",

}

Download

TY - GEN

T1 - MCENET

T2 - Multi-Context Encoder Network for Homogeneous Agent Trajectory Prediction in Mixed Traffic

AU - Cheng, Hao

AU - Liao, Wentong

AU - Yang, Michael Ying

AU - Sester, Monika

AU - Rosenhahn, Bodo

N1 - Funding Information: This work is supported by the German Research Founda- tion (DFG) through the Research Training Group SocialCars (GRK 1931) and grants COVMAP (RO 2497/12-2).

PY - 2020

Y1 - 2020

N2 - Trajectory prediction in urban mixed-traffic zones (a.k. a. shared spaces) is critical for many intelligent transportation systems, such as intent detection for autonomous driving. However, there are many challenges to predict the trajectories of heterogeneous road agents (pedestrians, cyclists and vehicles) at a microscopical level. For example, an agent might be able to choose multiple plausible paths in complex interactions with other agents in varying environments. To this end, we propose an approach named Multi-Context Encoder Network (MCENET) that is trained by encoding both past and future scene context, interaction context and motion information to capture the patterns and variations of the future trajectories using a set of stochastic latent variables. In inference time, we combine the past context and motion information of the target agent with samplings of the latent variables to predict multiple realistic trajectories in the future. Through experiments on several datasets of varying scenes, our method outperforms some of the recent state-of-the-art methods for mixed traffic trajectory prediction by a large margin and more robust in a very challenging environment. The impact of each context is justified via ablation studies.

AB - Trajectory prediction in urban mixed-traffic zones (a.k. a. shared spaces) is critical for many intelligent transportation systems, such as intent detection for autonomous driving. However, there are many challenges to predict the trajectories of heterogeneous road agents (pedestrians, cyclists and vehicles) at a microscopical level. For example, an agent might be able to choose multiple plausible paths in complex interactions with other agents in varying environments. To this end, we propose an approach named Multi-Context Encoder Network (MCENET) that is trained by encoding both past and future scene context, interaction context and motion information to capture the patterns and variations of the future trajectories using a set of stochastic latent variables. In inference time, we combine the past context and motion information of the target agent with samplings of the latent variables to predict multiple realistic trajectories in the future. Through experiments on several datasets of varying scenes, our method outperforms some of the recent state-of-the-art methods for mixed traffic trajectory prediction by a large margin and more robust in a very challenging environment. The impact of each context is justified via ablation studies.

KW - cs.CV

KW - cs.CY

KW - cs.MA

UR - http://www.scopus.com/inward/record.url?scp=85095370359&partnerID=8YFLogxK

U2 - 10.1109/ITSC45102.2020.9294296

DO - 10.1109/ITSC45102.2020.9294296

M3 - Conference contribution

SN - 978-1-7281-4150-3

BT - 2020 IEEE 23rd International Conference on Intelligent Transportation Systems, ITSC 2020

PB - Institute of Electrical and Electronics Engineers Inc.

ER -

By the same author(s)