MOPTA 2005
Derivative Free Optimization (DFO)
¡Solver for general nonlinear optimization problems with
lSmall (<100) number of variables
lExpensive to evaluate functions
lDerivatives or their estimates not available
l
¡Katya Scheinberg, Project Manager
l
¡
DFO is a Fortran package for solving general nonlinear optimization problems that have the following characteristics:
they are relatively small scale (less than 100 variables),
their objective function is relatively expensive to compute and derivatives of such functions are not available and
cannot be estimated efficiently.
There also may be some noise in the function evaluation procedures. Such optimization problems arise ,for example, in engineering design, where the objective function evaluation is a simulation package treated as a black box.

1. The "differentiator" of DFO is the absence of "differentiator", hah! :)
Well, it is a code that targets general nonlinear optimization  problems with expensive function evaluations and
without derivative computation. This is one of the few (so far) state of the art codes. It is very easy to
use (since practically all the user needs is to write a routine that computes a function value). It is also
robust, that is it is often works well without tuning to a specific problem.
Another unique feature is that it handles various kinds of constraints, such as derivative free, or general nonlinear
constraints with derivatives.

2. There is a fair number of users, but what exactly they are doing we do not know, usually.
There is a recent paper by Shafer, Karasozen, Uludag, Yapici, Ogur from Middle Eastern Technichal University in
Ankara, Turkey on optimization of stirrers (for chemical, biotechnological, pharmaceutical and food processes).
They use DFO as their optimization engine. The problems fall into the category that DFO targets.
DFO is also used with DEFT - Derivative Free Tuner, a circuit tuning tool that was developed at IBM for tuning of small
scale circuits which require high accuracy provided by PowerSpice simulator. This simulator does not compute
or approximate derivatives. Deft is the first tool based on mathematical sound optimization tool (DFO) and it works much better
than the predecessor. It is OK to talk about this publicly. Specifically DFO was used successfully for tuning clock distribution networks
on chips. The results are confidential, but the fact of use is not.