Empowerment as a Generic Utility Function for Agents in a Simple Team Sport Simulation

Abstract

Players in team sports cooperate in a coordinated manner to achieve common goals. Automated players in academic and commercial team sports simulations have tradi- tionally been driven by complex externally motivated value functions with heuristics based on knowledge of game tactics and strategy. Empowerment is an information-theoretic mea- sure of an agent’s potential to influence its environment, which has been shown to provide a useful intrinsic value function, without the need for external goals and motivation, for agents in single agent models. In this paper we expand on the concept of empowerment to propose the concept of team empowerment as an intrinsic, generic utility function for coop- erating agents. We show that agents motivated by team empowerment exhibit recognizable team behaviors in a simple team sports simulation based on Ultimate Frisbee.