Nicolas Zeitlin

EECS Department, University of California, Berkeley

Technical Report No. UCB/EECS-2012-129

May 30, 2012

http://www2.eecs.berkeley.edu/Pubs/TechRpts/2012/EECS-2012-129.pdf

Reinforcement learning applied to legged-robots opens up the possibility to design robots capable not simply of walking, but of adapting and learning how to walk autonomously without any human interaction. This new generation of robots can one day navigate disaster areas and explore unchartered terrain. In this paper we evaluate the need for a reinforcement learning algorithm to optimize the gait of OctoRoACH, a hand-sized eight-legged robot. We then perform an evaluation of a likelihood-ratio gradient policy and compare it against our hand-tuned results. Finally, we suggest a different approach to reduce the policy search space that can make the problem more manageable.

Advisors: Pieter Abbeel

---

BibTeX citation:

@mastersthesis{Zeitlin:EECS-2012-129,
    Author= {Zeitlin, Nicolas},
    Editor= {Abbeel, Pieter and Fearing, Ronald S.},
    Title= {Reinforcement Learning Methods to Enable Automatic Tuning of Legged Robots},
    School= {EECS Department, University of California, Berkeley},
    Year= {2012},
    Month= {May},
    Url= {http://www2.eecs.berkeley.edu/Pubs/TechRpts/2012/EECS-2012-129.html},
    Number= {UCB/EECS-2012-129},
    Abstract= {Reinforcement learning applied to legged-robots opens up the possibility to design robots capable not simply of walking, but of adapting and learning how to walk autonomously without any human interaction. This new generation of robots can one day navigate disaster areas and explore unchartered terrain. In this paper we evaluate the need for a reinforcement learning algorithm to optimize the gait of OctoRoACH, a hand-sized eight-legged robot. We then perform an evaluation of a likelihood-ratio gradient policy and compare it against our hand-tuned results. Finally, we suggest a different approach to reduce the policy search space that can make the problem more manageable.},
}

EndNote citation:

%0 Thesis
%A Zeitlin, Nicolas 
%E Abbeel, Pieter 
%E Fearing, Ronald S. 
%T Reinforcement Learning Methods to Enable Automatic Tuning of Legged Robots
%I EECS Department, University of California, Berkeley
%D 2012
%8 May 30
%@ UCB/EECS-2012-129
%U http://www2.eecs.berkeley.edu/Pubs/TechRpts/2012/EECS-2012-129.html
%F Zeitlin:EECS-2012-129