Scenario Co-Evolution for Reinforcement Learning on a Grid World Smart Factory Domain

Gabor, Thomas; Sedlmeier, Andreas; Kiermeier, Marie; Phan, Thomy; Henrich, Marcel; Pichlmair, Monika; Kempter, Bernhard; Klein, Cornel; Sauer, Horst; Schmid, Reiner und Wieghardt, Jan (2019): Scenario Co-Evolution for Reinforcement Learning on a Grid World Smart Factory Domain. In: Proceedings of the 2019 Genetic and Evolutionary Computation Conference (Gecco'19): S. 898-906

Abstract

Adversarial learning has been established as a successful paradigm in reinforcement learning. We propose a hybrid adversarial learner where a reinforcement learning agent tries to solve a problem while an evolutionary algorithm tries to find problem instances that are hard to solve for the current expertise of the agent, causing the intelligent agent to co-evolve with a set of test instances or scenarios. We apply this setup, called scenario co-evolution, to a simulated smart factory problem that combines task scheduling with navigation of a grid world. We show that the so trained agent outperforms conventional reinforcement learning. We also show that the scenarios evolved this way can provide useful test cases for the evaluation of any (however trained) agent.

• Dokumententyp: Zeitschriftenartikel
• Fakultät: Mathematik, Informatik und Statistik > Informatik
• Themengebiete: 000 Informatik, Informationswissenschaft, allgemeine Werke > 004 Informatik
• Sprache: Englisch