MS Defense by Deshraj

Event Details
  • Date/Time:
    • Friday November 30, 2018 - Saturday December 1, 2018
      1:00 pm - 2:59 pm
  • Location: CCB 247
  • Phone:
  • URL:
  • Email:
  • Fee(s):
  • Extras:
No contact information submitted.

Summary Sentence: EvalAI: Evaluating AI Systems at Scale

Full Summary: No summary paragraph submitted.

Title: EvalAI: Evaluating AI Systems at Scale


Abstract: Artificial Intelligence research has progressed tremendously in the last few years. There has been the introduction of several new multi-modal datasets and tasks due to which it is becoming much harder to compare new algorithms with existing ones. To solve this problem, this thesis introduces EvalAI, an open source platform for evaluating and comparing machine learning and artificial intelligence algorithms at scale. This platform is built to provide an open source, standardized, scalable solution for evaluating learned models using automatic metrics as well as with human-in-the-loop evaluation. By simplifying and standardizing the process of benchmarking, EvalAI seeks to lower the barrier to entry for participating in the global scientific effort to push the frontiers of machine learning and artificial intelligence, increasing the rate of measurable progress in these communities.


Date and Venue Details:

Date: 30th November 2018

Time: 1 pm to 2 pm

Venue: CCB 247

Additional Information

In Campus Calendar

Graduate Studies

Invited Audience
Faculty/Staff, Public, Graduate students, Undergraduate students
ms defense
  • Created By: Tatianna Richardson
  • Workflow Status: Published
  • Created On: Nov 29, 2018 - 8:47am
  • Last Updated: Nov 29, 2018 - 8:47am