On the influence of learning time on evolutionary online learning of cooperative behavior

Jörg Denzinger and Michael Kordt

appeared in:
Proc. GECCO 2001, San Francisco, Morgan Kaufmann, 2001, pp. 837-844


Abstract

We present an online learning approach for learning cooperative behavior in multi-agent systems based on invoking an offline learning method as a special action ``learn''. We apply this approach to evolutionary offline learning using situation-action-pairs and the near\-est-neighbor rule as agent architecture. For the application Pursuit Games we show that the online approach using evolutionary off\-line learning allows for good success rates for rather different game variants. Particularly, we perform experiments highlighting the influence of the time needed for learning and of the parameters of the evolutionary off\-line method.

Our results show that even a duration of ``learn'' which is several times longer than the usual duration of an agent's actions still achieves good success rates. The same applies to rather small values for the key parameters of the offline method. Together, this suggests that this evolutionary online learning approach is a very good alternative to the well-known online approaches based on reinforcement learning.



Download paper (165 Kbytes)

Generated: 06/09/2001