Terrance Wang

EECS Department, University of California, Berkeley

Technical Report No. UCB/EECS-2023-132

May 12, 2023

http://www2.eecs.berkeley.edu/Pubs/TechRpts/2023/EECS-2023-132.pdf

Techniques combining Neural Radiance Fields (NeRFs) and diffusion models have shown great promise for generating novel scenes and objects from text input. Most advancements in the generative 3D space have focused on fine tuning diffusion models to improve performance, but have neglected to investigate other aspects, such as the underlying NeRF architecture or noise sampling schedule. Because this is a novel approach, there are still many open questions in this research space that have not been properly explored. In this work, we explore some of these questions using the open-source platform Nerfstudio. By implementing these models and conducting experiments in this library, we are able to easily conduct training and evaluation, while also providing code for others to build on for their own experiments in this space. The following work shows that the choice of underlying NeRF model and noise sampling schedule does have an impact on generated outputs, and lays the groundwork for further experiments in this line of investigation.

Advisors: Ren Ng

---

BibTeX citation:

@mastersthesis{Wang:EECS-2023-132,
    Author= {Wang, Terrance},
    Editor= {Ng, Ren and Tancik, Matthew},
    Title= {An Exploration into 3D Generative Models with Nerfstudio},
    School= {EECS Department, University of California, Berkeley},
    Year= {2023},
    Month= {May},
    Url= {http://www2.eecs.berkeley.edu/Pubs/TechRpts/2023/EECS-2023-132.html},
    Number= {UCB/EECS-2023-132},
    Abstract= {Techniques combining Neural Radiance Fields (NeRFs) and diffusion models have shown great promise for generating novel scenes and objects from text input. Most advancements in the generative 3D space have focused on fine tuning diffusion models to improve performance, but have neglected to investigate other aspects, such as the underlying NeRF architecture or noise sampling schedule. Because this is a novel approach, there are still many open questions in this research space that have not been properly explored. In this work, we explore some of these questions using the open-source platform Nerfstudio. By implementing these models and conducting experiments in this library, we are able to easily conduct training and evaluation, while also providing code for others to build on for their own experiments in this space. The following work shows that the choice of underlying NeRF model and noise sampling schedule does have an impact on generated outputs, and lays the groundwork for further experiments in this line of investigation.},
}

EndNote citation:

%0 Thesis
%A Wang, Terrance 
%E Ng, Ren 
%E Tancik, Matthew 
%T An Exploration into 3D Generative Models with Nerfstudio
%I EECS Department, University of California, Berkeley
%D 2023
%8 May 12
%@ UCB/EECS-2023-132
%U http://www2.eecs.berkeley.edu/Pubs/TechRpts/2023/EECS-2023-132.html
%F Wang:EECS-2023-132