User Interface Issues of 3D Gesture Mobile Devices and Visual Feedback of Physiotherapy Application

Ryan Rho

EECS Department
University of California, Berkeley
Technical Report No. UCB/EECS-2013-88
May 17, 2013

http://www2.eecs.berkeley.edu/Pubs/TechRpts/2013/EECS-2013-88.pdf

We introduce and discuss new user interface issues raised by the advent of gesture recognition-enabled mobile devices. Compared to traditional hand gestures on touch screens of mobile devices, the effectiveness of gesture recognition on mobile devices depends on their screen sizes, the distance between the user and the device, and how the user holds the device. Due to these user interface issues, software developers who would like to apply gesture recognition to their applications should redesign their user interfaces different from typical mobile applications. To effectively visualize feedback of a physical therapy application for mKinect, the purpose of which is to bring the users Kinect experience onto their smartphones, we present a novel approach of visual feedback for a gesture recognition-enabled mobile devices. We display a shadow of the player and arrows of how the user should correct their joints when performing an exercise so that not only it is easy for the user to receive feedback but it is also accurate enough to perform a physiotherapy exercise.

Advisor: Björn Hartmann


BibTeX citation:

@mastersthesis{Rho:EECS-2013-88,
    Author = {Rho, Ryan},
    Title = {User Interface Issues of 3D Gesture Mobile Devices and Visual Feedback of Physiotherapy Application},
    School = {EECS Department, University of California, Berkeley},
    Year = {2013},
    Month = {May},
    URL = {http://www2.eecs.berkeley.edu/Pubs/TechRpts/2013/EECS-2013-88.html},
    Number = {UCB/EECS-2013-88},
    Abstract = {We introduce and discuss new user interface issues raised by the advent of gesture recognition-enabled mobile devices. Compared to traditional hand gestures on touch screens of mobile devices, the effectiveness of gesture recognition on mobile devices depends on their screen sizes, the distance between the user and the device, and how the user holds the device. Due to these user interface issues, software developers who would like to apply gesture recognition to their applications should redesign their user interfaces different from typical mobile applications. To effectively visualize feedback of a physical therapy application for mKinect, the purpose of which is to bring the users Kinect experience onto their smartphones, we present a novel approach of visual feedback for a gesture recognition-enabled mobile devices. We display a shadow of the player and arrows of how the user should correct their joints when performing an exercise so that not only it is easy for the user to receive feedback but it is also accurate enough to perform a physiotherapy exercise.}
}

EndNote citation:

%0 Thesis
%A Rho, Ryan
%T User Interface Issues of 3D Gesture Mobile Devices and Visual Feedback of Physiotherapy Application
%I EECS Department, University of California, Berkeley
%D 2013
%8 May 17
%@ UCB/EECS-2013-88
%U http://www2.eecs.berkeley.edu/Pubs/TechRpts/2013/EECS-2013-88.html
%F Rho:EECS-2013-88