Derivative Free Algorithms for Optimization of Function with Noise

Event Details
  • Date/Time:
    • Friday November 14, 2003
      10:00 am - 10:59 pm
  • Location: Groseclose, Room 404
  • Phone:
  • URL:
  • Email:
  • Fee(s):
  • Extras:
Barbara Christopher
Industrial and Systems Engineering
Contact Barbara Christopher

Summary Sentence: Derivative Free Algorithms for Optimization of Function with Noise

Full Summary: Derivative Free Algorithms for Optimization of Function with Noise

We consider a class of optimization problems that satisfies the following properties a) The objective function can only be evaluated with some error and at high computational cost. b) The error can be decreased with more compuational effort. c) The Higher order derivatives of the objective function are unavailable. Such problems commonly arise in engineering design(Eg. helipcopter rotor blade design), simulation optimization(Eg. Revenue management) etc. Our aim is to develop convergent algorithms that can solve such problems while requiring the fewest possible number of objective function evaluations.
In order to do so, we first develop a general framework of convergence for optimization algorithms. Using this framework, we can show the convergence of traditional non-linear programming algorithms that have been suitably modified to use approximations of the objective function and its gradient. Then, we present one particular scheme for approximating the gradient and hessian of the objective function using linear regression. Finally, we describe a trust region algorithm that uses linear regression to form a linear or quadratic model of the objective function and provide computational results for such an algorithm run on the problems from the CUTE test set.

Additional Information

In Campus Calendar

School of Industrial and Systems Engineering (ISYE)

Invited Audience
No audiences were selected.
No keywords were submitted.
  • Created By: Barbara Christopher
  • Workflow Status: Published
  • Created On: Oct 8, 2010 - 7:42am
  • Last Updated: Oct 7, 2016 - 9:52pm