AuthorIVE: Authoring Interactions for Virtual Environments through Disambiguating Demonstrations

Stephanie Claudino Daffara, Federico Saldarini, Balasaravanan Thoravi Kumaravel and Björn Hartmann

EECS Department
University of California, Berkeley
Technical Report No. UCB/EECS-2020-122
May 29, 2020

http://www2.eecs.berkeley.edu/Pubs/TechRpts/2020/EECS-2020-122.pdf

While Virtual Reality (VR) hardware is increasingly available and 3D model repositories are plentiful, creating immersive interactive experiences is still hard for non-programmers. Current content creation tools require reasoning about complex spatial interaction logic in some formal language (e.g., textual or visual programming). Programming by demonstration (PbD) has been a promising direction to allow systems to infer rules from examples. But gaps exist between algorithmic advances in PbD and appropriate user interfaces that enable authors to leverage PbD inference while remaining in control of the authoring process. We contribute a new hybrid authoring method - “disambiguating demonstrations”, in which users demonstrate interactions between objects in a VR environment and the system generates suggestions based on these interactions providing resolution of different options along the way.

Advisor: Björn Hartmann


BibTeX citation:

@mastersthesis{Claudino Daffara:EECS-2020-122,
    Author = {Claudino Daffara, Stephanie and Saldarini, Federico and Thoravi Kumaravel, Balasaravanan and Hartmann, Björn},
    Title = {AuthorIVE: Authoring Interactions for Virtual Environments through Disambiguating Demonstrations},
    School = {EECS Department, University of California, Berkeley},
    Year = {2020},
    Month = {May},
    URL = {http://www2.eecs.berkeley.edu/Pubs/TechRpts/2020/EECS-2020-122.html},
    Number = {UCB/EECS-2020-122},
    Abstract = {While Virtual Reality (VR) hardware is increasingly available and 3D model repositories are plentiful, creating immersive interactive experiences is still hard for non-programmers. Current content creation tools require reasoning about complex spatial interaction logic in some formal language (e.g., textual or visual programming). Programming by demonstration (PbD) has been a promising direction to allow systems to infer rules from examples. But gaps exist between algorithmic advances in PbD and appropriate user interfaces that enable authors to leverage PbD inference while remaining in control of the authoring process. We contribute a new hybrid authoring method - “disambiguating demonstrations”, in which users demonstrate interactions between objects in a VR environment and the system generates suggestions based on these interactions providing resolution of different options along the way.}
}

EndNote citation:

%0 Thesis
%A Claudino Daffara, Stephanie
%A Saldarini, Federico
%A Thoravi Kumaravel, Balasaravanan
%A Hartmann, Björn
%T AuthorIVE: Authoring Interactions for Virtual Environments through Disambiguating Demonstrations
%I EECS Department, University of California, Berkeley
%D 2020
%8 May 29
%@ UCB/EECS-2020-122
%U http://www2.eecs.berkeley.edu/Pubs/TechRpts/2020/EECS-2020-122.html
%F Claudino Daffara:EECS-2020-122