PhD Defense by Prithviraj Ammanabrolu

Event Details
  • Date/Time:
    • Wednesday July 14, 2021
      1:00 pm - 3:00 pm
  • Location: CODA C1215 Midtown
  • Phone:
  • URL: Bluejeans
  • Email:
  • Fee(s):
    N/A
  • Extras:
Contact
No contact information submitted.
Summaries

Summary Sentence: Language Learning in Interactive Environments

Full Summary: No summary paragraph submitted.

Title: Language Learning in Interactive Environments

 

Prithviraj Ammanabrolu
Ph.D. Candidate
School of Interactive Computing
Georgia Institute of Technology

http://prithvirajva.com

 

Date: Wednesday, July 14th, 2021
Time: 1:00 pm to 3:00 pm (ET)
Location: CODA C1215 Midtown

BlueJeans: https://bluejeans.com/7436488731/

 

Committee:
Dr. Mark Riedl (advisor), School of Interactive Computing, Georgia Institute of Technology

Dr. Charles Isbell, School of Interactive Computing, Georgia Institute of Technology
Dr. Devi Parikh, School of Interactive Computing, Georgia Institute of Technology
Dr. Matthew Hausknecht, Microsoft Research

Dr. Jason Weston, Facebook AI Research and New York University

 

Abstract:

Natural language communication has long been considered a defining characteristic of human intelligence. I am motivated by the question of how learning agents can understand and generate contextually relevant natural language in service of achieving a goal. In pursuit of this objective, I have been studying Interactive Narratives, or text-adventures: simulations in which an agent interacts with the world purely through natural language—"perceiving” and “acting upon” the world using textual descriptions and commands. These games are usually structured as puzzles or quests in which a player must complete a sequence of actions to succeed. My work studies two closely related aspects of Interactive Narratives: operating in these environments and creating them in addition to their intersection—each presenting its own set of unique challenges.

 

Operating in these environments presents three challenges: (1) Knowledge representation—an agent must maintain a persistent memory of what it has learned through its experiences with a partially observable world; (2) Commonsense reasoning to endow the agent with priors on how to interact with the world around it; and (3) Scaling to effectively explore sparse-reward, combinatorially-sized natural language state-action spaces. On the other hand, creating these environments can be split into two complementary considerations: (1) World generation, or the problem of creating a world that defines the limits of the actions an agent can perform; and (2) Quest generation, i.e. defining actionable objectives grounded in a given world. I will present my work thus far—showcasing how structured, interpretable data representations in the form of knowledge graphs aid in each of these tasks—in addition to proposing how exactly these two aspects of Interactive Narratives can be combined to improve language learning and generalization across this board of challenges.

Additional Information

In Campus Calendar
No
Groups

Graduate Studies

Invited Audience
Faculty/Staff, Public, Graduate students, Undergraduate students
Categories
Other/Miscellaneous
Keywords
Phd proposal
Status
  • Created By: Tatianna Richardson
  • Workflow Status: Published
  • Created On: Jun 30, 2021 - 8:48am
  • Last Updated: Jun 30, 2021 - 8:48am