Dr. Betsy DiSalvo, Co-advisor, School of Interactive Computing, Georgia Tech

Dr. Thad Starner, School of Interactive Computing, Georgia Tech

Dr. W. Keith Edwards, School of Interactive Computing, Georgia Tech

Dr. Björn Hartmann, Electrical Engineering & Computer Science, UC Berkeley

Dr. Yang Li, Google Research, Mountain View

Abstract:

------------------

Motion gestures are an expressive and fast-to-access input technique. Most mobile and wearable devices support their detection through embedded inertial sensors. Recent work on gesture authoring tools has shown that interaction designers can create and evaluate gesture recognizers in stationary and controlled environments. However, we still lack a generalized understanding of their design process and how to enable in situ and context-based motion gesture design. 

My research advances our understanding of these problems in two ways. First, by characterizing the factors impacting a gesture designer’s process, as well as their gesture designs and tools. Second, by demonstrating rapid motion gesture design in a variety of new contexts. Specifically, I present: (1) a novel triadic framework that enhances our understanding of the motion gestures, their designers, and the factors influencing design of authoring tools; (2) the first ever explorations of in situ and context-based prototyping of motion gestures through development of two generations of a smartphone-based tool, Mogeste, followed by Comoge; and (3) a description of the challenges and advantages of designing motion gestures in situ, based on the first user study with both professional as well as student interaction designers.