DOS Seminar- William B. Haskell

Event Details
  • Date/Time:
    • Friday September 22, 2017
      12:10 pm - 1:10 pm
  • Location: ISyE Executive Classroom
  • Phone:
  • URL:
  • Email:
  • Fee(s):
  • Extras:
No contact information submitted.

Summary Sentence: DOS Seminar- William B. Haskell

Full Summary: No summary paragraph submitted.

TITLE: Markov chain methods for analyzing algorithms


We are interested in using Markov chain methods to establish convergence in probability for various algorithms in dynamic programming and optimization.  We start by investigating simple "empirical" variants of classical value and policy iteration for dynamic programming.  In this case, we show that the progress of these algorithms is stochastically dominated by an easy to analyze Markov chain, from which we can extract a convergence rate for the original algorithms.  We continue by showing that this same line of reasoning covers several empirical algorithms in optimization as well.  We argue that the advantage of this approach lies in its simplicity and intuitive appeal.


Additional Information

In Campus Calendar

School of Industrial and Systems Engineering (ISYE)

Invited Audience
Faculty/Staff, Public, Undergraduate students
No categories were selected.
No keywords were submitted.
  • Created By: nhendricks6
  • Workflow Status: Published
  • Created On: Sep 20, 2017 - 2:48pm
  • Last Updated: Sep 20, 2017 - 2:48pm