Comparing PCG metrics with Human Evaluation in Minecraft Settlement Generation

Herve, Jean-Baptiste and Salge, Christoph (2021) Comparing PCG metrics with Human Evaluation in Minecraft Settlement Generation. In: FDG '21: Proceedings of the 16th International Conference on the Foundations of Digital Games :. ACM Press, NY, United States. ISBN 9781450384223
Copy

There are a range of metrics that can be applied to the artifacts produced by procedural content generation, and several of themcome with qualitative claims. In this paper, we adapt a range of existing PCG metrics to generated Minecraft settlements, developa few new metrics inspired by PCG literature, and compare the resulting measurements to existing human evaluations. The aim isto analyze how those metrics capture human evaluation scores in different categories, how the metrics generalize to another gamedomain, and how metrics deal with more complex artifacts. We provide an exploratory look at a variety of metrics and providean information gain and several correlation analyses. We found some relationships between human scores and metrics countingspecific elements, measuring the diversity of blocks and measuring the presence of crafting materials for the present complex blocks.


picture_as_pdf
HerveFDG2021.pdf
subject
Submitted Version
copyright
Available under Unspecified

View Download

Atom BibTeX OpenURL ContextObject in Span OpenURL ContextObject Dublin Core MPEG-21 DIDL Data Cite XML EndNote HTML Citation METS MODS RIOXX2 XML Reference Manager Refer ASCII Citation
Export

Downloads