Ph.D Defense by Crystal Chao

Event Details
  • Date/Time:
    • Thursday March 12, 2015
      10:00 am - 12:00 pm
  • Location: Marcus Nanotechnology Bldg., Room 1117-1118
  • Phone:
  • URL:
  • Email:
  • Fee(s):
    N/A
  • Extras:
Contact
No contact information submitted.
Summaries

Summary Sentence: Timing Multimodal Turn-Taking in Human-Robot Cooperative Activity

Full Summary: No summary paragraph submitted.

Ph.D. Dissertation Defense Announcement

Title: Timing Multimodal Turn-Taking in Human-Robot Cooperative Activity

Crystal Chao
Robotics Ph.D. candidate
School of Interactive Computing

Date: Thursday, March 12, 2015
Time: 10:00 am - 12:00 pm
Location: Marcus Nanotechnology Bldg., Room 1117-1118

Committee:
Dr. Andrea L. Thomaz (Advisor), School of Interactive Computing
Dr. Ronald C. Arkin, School of Interactive Computing
Dr. Henrik I. Christensen, School of Interactive Computing
Dr. Karen M. Feigh, School of Aerospace Engineering
Dr. Candace L. Sidner, Department of Computer Science, Worcester Polytechnic Institute

Abstract:

Turn-taking is a fundamental process that governs social interaction. When humans interact, they naturally take initiative and relinquish control to each other using verbal and nonverbal behavior in a coordinated manner. In contrast, existing approaches for controlling a robot's social behavior do not explicitly model turn-taking, resulting in interaction breakdowns in which the human is uncertain about when to act. They also lack generality, relying on scripted behavior control that must be designed for each new domain.

This thesis seeks to enable robots to cooperate fluently with humans by automatically controlling the timing of multimodal turn-taking. Based on our empirical studies of interaction phenomena, we develop a computational turn-taking model that accounts for multimodal information flow and resource usage in interaction. This model is implemented within a novel behavior generation architecture called CADENCE, the Control Architecture for the Dynamics of Embodied Natural Coordination and Engagement, that controls a robot's speech, gesture, gaze, and manipulation. CADENCE controls turn-taking using a timed Petri net (TPN) representation that integrates resource exchange, interruptible modality execution, and modeling of the human user. We demonstrate progressive developments of CADENCE through multiple domains of autonomous interaction encompassing situated dialogue and collaborative manipulation. We also iteratively evaluate improvements in the system using quantitative metrics of task success, fluency, and balance of control.

Additional Information

In Campus Calendar
No
Groups

Graduate Studies

Invited Audience
Public
Categories
Other/Miscellaneous
Keywords
dissertation, graduate students, Ph.d. Defense
Status
  • Created By: Tatianna Richardson
  • Workflow Status: Published
  • Created On: Feb 27, 2015 - 6:05am
  • Last Updated: Oct 7, 2016 - 10:11pm