Markov Chains & Optimality of the Hamiltonian Cycle

Event Details
  • Date/Time:
    • Tuesday April 1, 2008 - Wednesday April 2, 2008
      11:00 am - 11:59 am
  • Location: Groseclose Room 226A
  • Phone:
  • URL:
  • Email:
  • Fee(s):
  • Extras:
Maria Vlasiou
Contact Maria Vlasiou

Summary Sentence: Markov Chains & Optimality of the Hamiltonian Cycle

Full Summary: Markov Chains & Optimality of the Hamiltonian Cycle

Presentation: Markov Chains & Optimality of the Hamiltonian Cycle

Abstract: We consider the Hamiltonian cycle problem (HCP) embedded in a controlled Markov decision process. In this setting, HCP reduces to an optimization problem on a set of Markov chains corresponding to a given graph. We prove that Hamiltonian cycles are minimizers for the trace of the fundamental matrix on a set of all stochastic transition matrices. In case of doubly stochastic matrices with symmetric linear perturbation, we show that Hamiltonian cycles minimize a diagonal element of a fundamental matrix for all admissible values of the perturbation parameter. In contrast to the previous work on this topic, our arguments are primarily based on probabilistic rather than algebraic methods.

Joint work with Vladimir Ejov

Bio: Nelly Litvak is an Assistant Professor at the University of Twente, The Netherlands, in the Stochastic Operations Research group. Her research interests are in stochastic networks, popularity measures and probabilistic ranking schemes in complex networks, queueing theory, perturbed Markov chains, queueing models in health care logistics, performance analysis of carousel systems.

For more information, visit:

Additional Information

In Campus Calendar

School of Industrial and Systems Engineering (ISYE)

Invited Audience
No audiences were selected.
Markov Chains & Optimality of the Hamiltonian Cycle
  • Created By: Barbara Christopher
  • Workflow Status: Published
  • Created On: Oct 12, 2009 - 5:20pm
  • Last Updated: Oct 7, 2016 - 9:47pm