Time: 2:30 PM
Place: 2nd Floor Lecture Hall, MSRI (2850 Telegraph Ave.)
**The lecture will be followed by a reception in the 6th Floor Lounge of MSRI.**
Title: On Sizing and Shifting the BFGS Update within the Sized- Broyden Family of Secant Updates
Abstract: In the 35 years since it's birth the BFGS Secant method has become the secant method of choice in algorithmic methods for unconstrained optimization. Its popularity is a direct result of its observed superior numerical behavior. However, there are situations where the BFGS secant method is not effective and the Hessian approximations that it generates have excessively large eigenvalues. In a numerical study, Contreras and Tapia demonstrated that in these situations there is value in sizing the BFGS secant update using the Oren-Luenberger sizing factor, i.e., multiplying the Hessian approximation by a constant before updating. A conclusion of the current study is that there is value in following an Oren-Luenberger sizing of the BFGS update with a shift of the BFGS in the Broyden class of secant updates. Our motivation for such a strategy comes from the fact that if the BFGS update is producing updates with large eigenvalues, then sizing may contribute to near singularity, and shifting can help compensate for this deficiency. Our main contribution is that we obtain a shift formula in closed form by minimizing a weighted form of the Byrd--Nocedal measure over a sized Broyden family of secant updates. Numerically, our most effective shift is the one that gives the member of the class which is closest to steepest descent in the Byrd--Nocedal measure. While this choice is a surprise it is supported by numerical experimentation.
You will need Quicktime Plugin on your browser. If you are having trouble viewing the video here, please try opening the url in a video player which supports RTSP streams [e.g. QuickTime Player, VLC, MPlayer, etc.]:
tapia2-tapia2-DVD PCM Audio.aiff
tapia2-tapia2-MPEG-2 120min High Quality Encode.m2v