Transformer in reinforcement learning for decision-making: a survey

2024, Volume 25, Issue 6

Abstract

Keywords

Related Research

Frontiers of Information Technology & Electronic Engineering >> 2024, Volume 25, Issue 6 doi: 10.1631/FITEE.2300548

Transformer in reinforcement learning for decision-making: a survey

Affiliation(s): College of Information and Communication, National University of Defense Technology, Wuhan 430014, China; College of Intelligence Science and Technology, National University of Defense Technology, Changsha 410072, China; Laboratory for Parallel and Distributed Processing, National University of Defense Technology, Changsha 410072, China; less

Received: 2023-08-14 Accepted: 2024-07-05 Available online: 2024-07-05

HTML0 PDF 0 Collect 0

Next Previous

Abstract

has become a dominant decision-making paradigm and has achieved notable success in many real-world applications. Notably, deep neural networks play a crucial role in unlocking RL’s potential in large-scale decision-making tasks. Inspired by current major success of in natural language processing and computer vision, numerous bottlenecks have been overcome by combining with RL for decision-making. This paper presents a multiangle systematic survey of various -based RL (TransRL) models applied in decision-making tasks, including basic models, advanced algorithms, representative implementation instances, typical applications, and known challenges. Our work aims to provide insights into problems that inherently arise with the current RL approaches, and examines how we can address them with better TransRL models. To our knowledge, we are the first to present a comprehensive review of the recent research developments in RL for decision-making. We hope that this survey provides a comprehensive review of TransRL models and inspires the RL community in its pursuit of future directions. To keep track of the rapid TransRL developments in the decision-making domains, we summarize the latest papers and their open-source implementations at https://github.com/williamyuanv0/-in-Reinforcement-Learning-for-Decision-Making-A-Survey.

Keywords

Transformer ; Reinforcement learning (RL) ; Decision-making (DM) ; Deep neural network (DNN) ; Multi-agent reinforcement learning (MARL) ; Meta-reinforcement learning (Meta-RL)

Related Research