Positive Definiteness of Symmetric Rank 1 (H-Version) Update for Unconstrained Optimization
Main Article Content
Abstract
Several attempts have been made to modify the quasi-Newton condition in order to obtain rapid convergence with complete properties (symmetric and positive definite) of the inverse of Hessian matrix (second derivative of the objective function). There are many unconstrained optimization methods that do not generate positive definiteness of the inverse of Hessian matrix. One of those methods is the symmetric rank 1( H-version) update (SR1 update), where this update satisfies the quasi-Newton condition and the symmetric property of inverse of Hessian matrix, but does not preserve the positive definite property of the inverse of Hessian matrix where the initial inverse of Hessian matrix is positive definiteness. The positive definite property for the inverse of Hessian matrix is very important to guarantee the existence of the minimum point of the objective function and determine the minimum value of the objective function.
Received 24/4/2020
Accepted 3/12/2020
Published Online First 20/9/2021
Article Details
This work is licensed under a Creative Commons Attribution 4.0 International License.
How to Cite
References
Wenyu S, Ya-Xiang Y. Optimization Theory and Method: Nonlinear Programming. Springer, USA. 2006.
Zhang J, Xu Ch. Properties and Numerical Performance of Modified quasi–Newton Methods Equations. Elsevier, J. Comp. App. Math. 2001; 137: 269-278
Yabe H, Ogasawara H, Yoshino M. Local and superlinear convergence of quasi-Newton methods based on modified secant conditions. J. Comp. App. Math. 2007 Aug; 1;205(1):617-32.
Guo Q, Liu J. Global convergence properties of two modified BFGS-type methods. J. App. Math. Comp. 2007; 23: 311–319.
Mahmood S S, Shnywer S H. On Modified DFP Update for Unconstrained Optimization. American J. App. Math. 2017; 5(1): 19-30.
Mahmood S S, Muhanah N S. Symmetric and Positive Definite Broyden Update for Unconstrained Optimization. BSJ. 2019; 16(3): 661-666.
Razieh D, Narges B, Mohammad M H. A new modified BFGS method for solving system of nonlinear equations. J. Interdisciplinary Math. 2019; 22: 75-89.
Razieh D, Narges B, Mohammad M H. A new modified BFGS method for unconstrained optimization problems. J. Comp. App. Math. 2018; 37: 5113-5125.
Bojari S, Eslachachi M R. Global convergence of a family of modified BFGS methods under a modified weak-Wolfe–Powell line search for nonconvex functions. 4OR. 2020;18(2): 219-244.
Yuan Y X. Amodified BFGS algorithm for unconstrained optimization.IMA.1991; 11(3): 325-332.
Mahmood S S, Farqad H. On Extended Symmetric Rank One Update for Unconstrained Optimization. J. Edu. 2017; 1: 206-220.
Conn A R, Gould N I, Toint P L. Convergence of quasi-Newton matrices generated by the symmetric rank one update. J. Math. Programming. 1991; 50(2): 177–195.