Comparing Human and AI Behavior in 3D Navigation Environments

Jeffrey Liu

EECS Department
University of California, Berkeley
Technical Report No. UCB/EECS-2021-111
May 14, 2021

http://www2.eecs.berkeley.edu/Pubs/TechRpts/2021/EECS-2021-111.pdf

While modern artificial intelligence agents have achieved superhuman performance in specific tasks, training artificial agents that can efficiently explore and generalize to new tasks remains an open problem. Recent work has turned to humans as a source of inspiration to tackle this problem. Humans have shown an ability to explore the world in such a way that translates to generalizable skills in later life, a trait that modern artificial intelligence has failed to replicate. Investigating the specific ways in which humans and artificial agents deviate in behavior may thus lend insight into ways that algorithms can be improved. In this work we present an online platform to design and carry out experiments comparing human and agent behavior in 3D navigation tasks. We also present a comparison of behaviors between humans and agents in both procedurally-designed and human-designed mazes, highlighting ways in which current algorithms are both similar and distinct from humans.

Advisor: Trevor Darrell


BibTeX citation:

@mastersthesis{Liu:EECS-2021-111,
    Author = {Liu, Jeffrey},
    Title = {Comparing Human and AI Behavior in 3D Navigation Environments},
    School = {EECS Department, University of California, Berkeley},
    Year = {2021},
    Month = {May},
    URL = {http://www2.eecs.berkeley.edu/Pubs/TechRpts/2021/EECS-2021-111.html},
    Number = {UCB/EECS-2021-111},
    Abstract = {While modern artificial intelligence agents have achieved superhuman performance in specific tasks, training artificial agents that can efficiently explore and generalize to new tasks remains an open problem. Recent work has turned to humans as a source of inspiration to tackle this problem. Humans have shown an ability to explore the world in such a way that translates to generalizable skills in later life, a trait that modern artificial intelligence has failed to replicate. Investigating the specific ways in which humans and artificial agents deviate in behavior may thus lend insight into ways that algorithms can be improved. In this work we present an online platform to design and carry out experiments comparing human and agent behavior in 3D navigation tasks. We also present a comparison of behaviors between humans and agents in both procedurally-designed and human-designed mazes, highlighting ways in which current algorithms are both similar and distinct from humans.}
}

EndNote citation:

%0 Thesis
%A Liu, Jeffrey
%T Comparing Human and AI Behavior in 3D Navigation Environments
%I EECS Department, University of California, Berkeley
%D 2021
%8 May 14
%@ UCB/EECS-2021-111
%U http://www2.eecs.berkeley.edu/Pubs/TechRpts/2021/EECS-2021-111.html
%F Liu:EECS-2021-111