Virtual Walkthrough of 3D Captured Scenes in Web-based Virtual Reality

Austin Chen

EECS Department
University of California, Berkeley
Technical Report No. UCB/EECS-2017-1
January 9, 2017

http://www2.eecs.berkeley.edu/Pubs/TechRpts/2017/EECS-2017-1.pdf

In the last few years, virtual reality head mounted displays (VR HMDs) have seen an explosion of consumer interest. However, virtual content that utilizes the capabilities of these new HMDs is still rather scant. In this thesis, we present a streamlined application that allows users to virtually navigate through photorealistic rendered 3D scenes that were captured by a human-operated backpack system. Our app provides users the ability to look around captured 360-degree panoramas by orienting their headsets, traverse between panoramas by selecting target destinations, visualize normal and depth data by controlling a pancake cursor, and take distance measurements among any two points in space. We discuss the various technical challenges of building the first web-based VR app compatible with the Android-based Daydream VR headset and controller. We also outline techniques for monitoring and optimizing the performance of our web-based VR app, which allowed us to achieve a 5x increase in framerate over our original naive implementation.

Advisor: Avideh Zakhor


BibTeX citation:

@mastersthesis{Chen:EECS-2017-1,
    Author = {Chen, Austin},
    Title = {Virtual Walkthrough of 3D Captured Scenes in Web-based Virtual Reality},
    School = {EECS Department, University of California, Berkeley},
    Year = {2017},
    Month = {Jan},
    URL = {http://www2.eecs.berkeley.edu/Pubs/TechRpts/2017/EECS-2017-1.html},
    Number = {UCB/EECS-2017-1},
    Abstract = {In the last few years, virtual reality head mounted displays (VR HMDs) have seen an explosion of consumer interest. However, virtual content that utilizes the capabilities of these new HMDs is still rather scant. In this thesis, we present a streamlined application that allows users to virtually navigate through photorealistic rendered 3D scenes that were captured by a human-operated backpack system. Our app provides users the ability to look around captured 360-degree panoramas by orienting their headsets, traverse between panoramas by selecting target destinations, visualize normal and depth data by controlling a pancake cursor, and take distance measurements among any two points in space. We discuss the various technical challenges of building the first web-based VR app compatible with the Android-based Daydream VR headset and controller. We also outline techniques for monitoring and optimizing the performance of our web-based VR app, which allowed us to achieve a 5x increase in framerate over our original naive implementation.}
}

EndNote citation:

%0 Thesis
%A Chen, Austin
%T Virtual Walkthrough of 3D Captured Scenes in Web-based Virtual Reality
%I EECS Department, University of California, Berkeley
%D 2017
%8 January 9
%@ UCB/EECS-2017-1
%U http://www2.eecs.berkeley.edu/Pubs/TechRpts/2017/EECS-2017-1.html
%F Chen:EECS-2017-1