Designing Video-Based Interactive Instructions

Pei-Yu (Peggy) Chi

EECS Department
University of California, Berkeley
Technical Report No. UCB/EECS-2016-150
August 15, 2016

http://www2.eecs.berkeley.edu/Pubs/TechRpts/2016/EECS-2016-150.pdf

When attempting to accomplish unfamiliar tasks, people often look for tutorials to follow instructions. While it is easy to access online instructions shared by domain experts, navigating step-by-step guidance using existing tools remains inefficient. In addition, producing high-quality instructions that are easy to follow requires authoring expertise and a significant time investment in editing. This dissertation introduces video-based recording, editing, and playback tools optimized for creating and consuming tutorials from author demonstrations. Our interactive systems capture videos and high-level events that are important to a learner. Using video and audio analysis techniques, we develop algorithms that automatically produce high-quality instructions, which dramatically reduce the effort required for amateur creators. By introducing novel tutorial formats combined with video content, these designs in turn improve viewers’ learning experience.

We present a series of authoring tools that enable amateur authors to create effective tutorials: 1) MixT is a system that automatically generates step-by-step mixed media tutorials from software demonstrations. 2) DemoWiz is a tool that provides an increased awareness of upcoming events in a software demonstration video. 3) DemoCut is a semi-automatic video editing tool for physical tasks. 4) Kinectograph is a recording device that automatically follows an instructor for filming a physical demonstration. 5) DemoDraw is a multi-modal system to generate step-by-step motion illustrations from author’s body movements. Current authoring practices from professionals are encoded into automatic algorithms and interactive techniques. These systems are evaluated through a series of studies, which demonstrate that users can efficiently create and follow concise instructions using our tools.

Advisor: Björn Hartmann


BibTeX citation:

@phdthesis{Chi:EECS-2016-150,
    Author = {Chi, Pei-Yu (Peggy)},
    Title = {Designing Video-Based Interactive Instructions},
    School = {EECS Department, University of California, Berkeley},
    Year = {2016},
    Month = {Aug},
    URL = {http://www2.eecs.berkeley.edu/Pubs/TechRpts/2016/EECS-2016-150.html},
    Number = {UCB/EECS-2016-150},
    Abstract = {When attempting to accomplish unfamiliar tasks, people often look for tutorials to follow instructions. While it is easy to access online instructions shared by domain experts, navigating step-by-step guidance using existing tools remains inefficient. In addition, producing high-quality instructions that are easy to follow requires authoring expertise and a significant time investment in editing. This dissertation introduces video-based recording, editing, and playback tools optimized for creating and consuming tutorials from author demonstrations. Our interactive systems capture videos and high-level events that are important to a learner. Using video and audio analysis techniques, we develop algorithms that automatically produce high-quality instructions, which dramatically reduce the effort required for amateur creators. By introducing novel tutorial formats combined with video content, these designs in turn improve viewers’ learning experience.

We present a series of authoring tools that enable amateur authors to create effective tutorials: 1) MixT is a system that automatically generates step-by-step mixed media tutorials from software demonstrations. 2) DemoWiz is a tool that provides an increased awareness of upcoming events in a software demonstration video. 3) DemoCut is a semi-automatic video editing tool for physical tasks. 4) Kinectograph is a recording device that automatically follows an instructor for filming a physical demonstration. 5) DemoDraw is a multi-modal system to generate step-by-step motion illustrations from author’s body movements. Current authoring practices from professionals are encoded into automatic algorithms and interactive techniques. These systems are evaluated through a series of studies, which demonstrate that users can efficiently create and follow concise instructions using our tools.}
}

EndNote citation:

%0 Thesis
%A Chi, Pei-Yu (Peggy)
%T Designing Video-Based Interactive Instructions
%I EECS Department, University of California, Berkeley
%D 2016
%8 August 15
%@ UCB/EECS-2016-150
%U http://www2.eecs.berkeley.edu/Pubs/TechRpts/2016/EECS-2016-150.html
%F Chi:EECS-2016-150