Shivin Devgon

EECS Department, University of California, Berkeley

Technical Report No. UCB/EECS-2021-100

May 14, 2021

http://www2.eecs.berkeley.edu/Pubs/TechRpts/2021/EECS-2021-100.pdf

In industrial part kitting, 3D objects are inserted into cavities for transportation or subsequent assembly. Kitting is a critical step in industrial transportation and assembly, as kitting can decrease downstream processing and handling times and enable lower storage and shipping costs. Incorporating recent advances in deep learning and depth sensing can allow us to better automate this crucial process. We present Kit-Net, a framework for kitting previously unseen 3D objects into cavities given depth images of both the target cavity and an object held by a gripper in an unknown initial orientation. Kit-Net uses self-supervised deep learning and data-augmentation to train a Convolutional Neural Network (CNN) to robustly estimate 3D rotations between objects and matching concave or convex cavities using a large dataset of simulated depth image pairs. Kit-Net then uses the trained CNN to implement a controller to orient and position novel objects for insertion into novel prismatic and conformal 3D cavities. Experiments in simulation suggest that Kit-Net can orient objects to have a 99% average intersection volume between the object mesh and that of the target cavity. Physical experiments with 3 industrial objects suggest that Kit-Net can successfully insert objects into cavities with a 63% success rate while a baseline which restricts itself to 2D rotations succeeds only 18% of the time.

Advisors: Ken Goldberg

---

BibTeX citation:

@mastersthesis{Devgon:EECS-2021-100,
    Author= {Devgon, Shivin},
    Editor= {Goldberg, Ken},
    Title= {Automating Kitting Novel 3D Objects into Novel 3D Cavities Using Self-Supervised Learning of SE(3) Transforms},
    School= {EECS Department, University of California, Berkeley},
    Year= {2021},
    Month= {May},
    Url= {http://www2.eecs.berkeley.edu/Pubs/TechRpts/2021/EECS-2021-100.html},
    Number= {UCB/EECS-2021-100},
    Abstract= {In industrial part kitting, 3D objects are inserted into cavities for transportation or subsequent assembly. Kitting is a critical step in industrial transportation and assembly, as kitting can decrease downstream processing and handling times and enable lower storage and shipping costs. Incorporating recent advances in deep learning and depth sensing can allow us to better automate this crucial
process.
We present Kit-Net, a framework for kitting previously unseen 3D objects into cavities given depth images of both the target cavity and an object held by a gripper in an unknown initial orientation. Kit-Net uses self-supervised deep learning and data-augmentation to train a Convolutional Neural Network (CNN) to robustly estimate 3D rotations between objects and matching concave or convex
cavities using a large dataset of simulated depth image pairs. Kit-Net then uses the trained CNN to implement a controller to orient and position novel objects for insertion into novel prismatic and conformal 3D cavities. Experiments in simulation suggest that Kit-Net can orient objects to have a 99% average intersection volume between the object mesh and that of the target cavity.
Physical experiments with 3 industrial objects suggest that Kit-Net can successfully insert objects into cavities with a 63% success rate while a baseline which restricts itself to 2D rotations succeeds only 18% of the time.},
}

EndNote citation:

%0 Thesis
%A Devgon, Shivin 
%E Goldberg, Ken 
%T Automating Kitting Novel 3D Objects into Novel 3D Cavities Using Self-Supervised Learning of SE(3) Transforms
%I EECS Department, University of California, Berkeley
%D 2021
%8 May 14
%@ UCB/EECS-2021-100
%U http://www2.eecs.berkeley.edu/Pubs/TechRpts/2021/EECS-2021-100.html
%F Devgon:EECS-2021-100