SECANT TYPE METHOD WITH APPROXIMATION OF THE INVERSE OPERATOR FOR THE NONLINEAR LEAST SQUARE PROBLEM

Анотація

In this article, we propose a difference method with successive approximation of the inverse operator for finding an approximate solution of the nonlinear least squares problem. Classical methods are effective for such problems, but still there are types of problems for which they cannot be applied. Besides, these methods require the calculation of the inverse matrix or solving a system of linear equations at each iteration, which complicates the task. Hence, the considered method consists of two parts: the first part is for finding an approximation to the solution, while the second part is for approximation of the inverse operator instead of finding the inverse matrix. This part uses the first-order divided difference of the function instead of the Jacobian matrix. The analysis of local convergence of the proposed method is carried out under the classical Lipschitz conditions. This method was also applied for solving test problems to show the effectiveness of the method and to demonstrate its properties. These test functions also contain non-differentiable parts. For comparison, the number of iterations for the Secant method and the method with the approximation of the inverse operator are shown. Additionally, methods are compared for different initial approximations. 
Furthermore, the proposed method can be used for regression analysis problems and in the study of some physical processes if there are difficulties with calculating the derivatives of a nonlinear function and with finding the inverse operator of the divided difference.