Show simple item record

dc.contributor.authorSalge, Christoph
dc.contributor.authorGlackin, Cornelius
dc.contributor.authorPolani, D.
dc.date.accessioned2015-03-10T14:03:33Z
dc.date.available2015-03-10T14:03:33Z
dc.date.issued2014-05-21
dc.identifier.citationSalge , C , Glackin , C & Polani , D 2014 , ' Changing the Environment Based on Empowerment as Intrinsic Motivation ' , Entropy , vol. 16 , no. 5 , pp. 2789-2819 . https://doi.org/10.3390/e16052789
dc.identifier.otherPURE: 8229021
dc.identifier.otherPURE UUID: 4504b81e-d50b-4e16-9222-6d4165e0c19d
dc.identifier.otherScopus: 84901395918
dc.identifier.urihttp://hdl.handle.net/2299/15599
dc.descriptionThis is an open access article distributed under the Creative Commons Attribution License CC BY 3.0 which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
dc.description.abstractOne aspect of intelligence is the ability to restructure your own environment so that the world you live in becomes more beneficial to you. In this paper we investigate how the information-theoretic measure of agent empowerment can provide a task-independent, intrinsic motivation to restructure the world. We show how changes in embodiment and in the environment change the resulting behaviour of the agent and the artefacts left in the world. For this purpose, we introduce an approximation of the established empowerment formalism based on sparse sampling, which is simpler and significantly faster to compute for deterministic dynamics. Sparse sampling also introduces a degree of randomness into the decision making process, which turns out to beneficial for some cases. We then utilize the measure to generate agent behaviour for different agent embodiments in a Minecraft-inspired three dimensional block world. The paradigmatic results demonstrate that empowerment can be used as a suitable generic intrinsic motivation to not only generate actions in given static environments, as shown in the past, but also to modify existing environmental conditions. In doing so, the emerging strategies to modify an agent’s environment turn out to be meaningful to the specific agent capabilities, i.e., de facto to its embodiment.en
dc.format.extent20
dc.language.isoeng
dc.relation.ispartofEntropy
dc.rightsOpen
dc.titleChanging the Environment Based on Empowerment as Intrinsic Motivationen
dc.contributor.institutionSchool of Computer Science
dc.contributor.institutionScience & Technology Research Institute
dc.contributor.institutionCentre for Computer Science and Informatics Research
dc.contributor.institutionAdaptive Systems
dc.description.statusPeer reviewed
dc.relation.schoolSchool of Computer Science
dc.description.versiontypeFinal Published version
dcterms.dateAccepted2014-05-21
rioxxterms.versionVoR
rioxxterms.versionofrecordhttps://doi.org/10.3390/e16052789
rioxxterms.licenseref.urihttp://creativecommons.org/licenses/by/4.0/
rioxxterms.typeJournal Article/Review
herts.preservation.rarelyaccessedtrue
herts.rights.accesstypeOpen


Files in this item

Thumbnail

This item appears in the following Collection(s)

Show simple item record