This is a preview and has not been published.

Modifications for Quasi-Newton Method and Its Spectral Algorithm for Solving Unconstrained Optimization Problems


  • Evar Lutfalla Sadraddin Department of Mathematics, College of Science, University of Erbil, Erbil, Iraq.
  • Ivan Subhi Latif Department of Mathematics, College of Education, University of Salahaddin, Erbil, Iraq.



BFGS algorithm, Inexact line search, Numerical optimization, Spectral quasi-Newton method, Unconstrained optimization


In this paper, two modifications for spectral quasi-Newton algorithm of type BFGS are imposed. In the first algorithm, named SQNEI, a certain spectral parameter is used in such a step for BFGS algorithm differs from other presented algorithms. The second algorithm, SQNEv-Iv, has both new parameter position and value suggestion. In SQNEI and SQNEv-Iv methods, the parameters are involved in a search direction after an approximated Hessian matrix is updated. It is provided that two methods are effective under some assumptions. Moreover, the sufficient descent property is proved as well as the global and superlinear convergence for SQNEv-Iv and SQNEI.  Both of them are superior the standard BFGS (QNBFGS) and previous spectral quasi-Newton (SQNLC). However, SQNEv-Iv is outstanding SQNEI if it is convergent to the solution. This means that, two modified methods are in the race for the more efficiency method in terms less iteration numbers and consuming time in running CPU. Finally, numerical results are presented for the four algorithms by running list of test problems with inexact line search satisfying Armijo condition.


Download data is not yet available.


Andrei N. Nonlinear conjugate gradient methods for unconstrained optimization. Berlin, Heidelberg: Springer; 2020 Jun 23.

Mahmood SS. Modified BFGS Update (H-Version) Based on the Determinant Property of Inverse of Hessian Matrix for Unconstrained Optimization. Baghdad Sci. J. 2020;17(3(Suppl.)): 0994.

Mahmood SS, Eidi JH, Jasem JA. Positive Definiteness of Symmetric Rank 1 (H-Version) Update for Unconstrained Optimization. Baghdad Sci. J. 2022;19(2):297-303.

Cheng W, Li DH. Spectral Scaling BFGS Method. J Optim Theory Appl. 2010;146:305-319.

Nakayama S, Narushima Y, Yabe H. A memoryless symmetric rank-one method with sufficient descent property for unconstrained optimization. J Oper Res Soc Japan. 2018;61(1):53-70.

Nakayama S, Narushima Y. GLOBAL CONVERGENCE OF A PROXIMAL MEMORYLESS SYMMETRIC RANK ONE METHOD FOR MINIMIZING COMPOSITE FUNCTIONS. Proc of Int Conf Nonlinear Analysis and Convex Analysis & Int Conf on Optimization: Techniques and Applications-II. Hakodate, Japan. 2019:99-108.

Nakayama S. A hybrid method of three-term conjugate gradient method and memoryless quasi-newton method for unconstrained optimization. SUT J Math. 2018;54(1):79-98.

Lv J, Deng S, Wan Z. An Efficient Single-Parameter Scaling Memoryless Broyden-Fletcher-Goldfarb-Shanno Algorithm for Solving Large Scale Unconstrained Optimization Problems. IEEE Access. 2020;8:85664-85674.

Al-Naemi GM, Sheekoo AH. New scaled algorithm for non-linear conjugate gradients in unconstrained optimization. Indones J Electr Eng Comput Sci. 2021;24(3):1589-1595.

Wang L, Cao M, Xing F, Yang Y. The new spectral conjugate gradient method for large-scale unconstrained optimisation. J Inequalities Appl. 2020;2020(1).

Al-Arbo AA, Al-Kawaz RZ. A fast spectral conjugate gradient method for solving nonlinear optimization problems. Indones J Electr Eng Comput Sci. 2021;21(1):429-439.

Qasim AM, Salih ZF. New Spectral Idea for Conjugate Gradient Methods and Its Global Convergence Theorems. 2022;15(2):784-795.

Nakayama S, Narushima Y, Nishio H, Yabe H. An active-set memoryless quasi-Newton method based on a spectral-scaling Broyden family for bound constrained optimization. Results Control Optim. 2021;3:100012.

Ibrahim SM, Yakubu UA, Mamat M. Application of spectral conjugate gradient methods for solving unconstrained optimization problems. Int J Optim Control Theor Appl. 2020;10(2):198-205.

Ibrahim MAH, Mamat M, Leong WJ. The Hybrid BFGS-CG Method in Solving Unconstrained Optimization Problems. Abstr Appl Anal. 2014;2014:1-6.

Han L, Neumann M. Combining Quasi-Newton and Steepest Descent Directions. January 2003; 1-30.

Andrei N. An Unconstrained Optimization Test Functions Collection. Adv Model Optim. 2008;10(1):147-161.

Jamil M, Yang XS. A literature survey of benchmark functions for global optimisation problems. Int J Math Model Numer Optim. 2013;4(2):150-194.