K-Nearest Neighbor Method with Principal Component Analysis for Functional Nonparametric Regression

Main Article Content

Shelan Saied Ismaeel
Kurdistan M.Taher Omar
Bo Wang


This paper proposed a new  method to study functional non-parametric regression data analysis with conditional expectation in the case that the covariates  are functional and the Principal Component Analysis was utilized to de-correlate the multivariate response variables. It  utilized the formula of the Nadaraya Watson estimator (K-Nearest Neighbour (KNN)) for prediction with different types of the semi-metrics, (which are based on Second Derivative and Functional Principal Component Analysis (FPCA))  for measureing the closeness between curves.  Root Mean Square Errors is used for the  implementation of this model which is then compared to the independent response method. R program is used for analysing data. Then, when  the covariates  are functional and the Principal Component Analysis was utilized to de-correlate the multivariate response variables model, results are more preferable than the independent response method. The models are demonstrated by both a simulation data and real data.


Download data is not yet available.

Article Details

How to Cite
Ismaeel SS, Omar KM, Wang B. K-Nearest Neighbor Method with Principal Component Analysis for Functional Nonparametric Regression. Baghdad Sci.J [Internet]. 2022 Dec. 5 [cited 2023 Jan. 28];19(6(Suppl.):1612. Available from: https://bsj.uobaghdad.edu.iq/index.php/BSJ/article/view/6476


Ramsay JO, Silverman BW . Functional Data Analysis. 2nd Ed., Springer, New York. 2005. https://link.springer.com/book/10.1007/b98888

Cao G, Wang S, Wang L. Estimation and inference for functional linear regression models with partially varying regression coefficients. Stat. 2020; 9(1): e286.

Klepsch J, Klüppelberg C. An innovations algorithm for the prediction of functional linear processes. J Multivar Anal. 2017 Mar 1; 155: 252-71.

Chiou J M, Müller H G, Wang J L. Functional response models. Stat Sin. 2004: 675–693.

Wang B, Xu A. Gaussian process methods for nonparametric functional regression with mixed predictors. Comput Stat Data Anal. 2019 Mar 1; 131: 80-90.

Górecki T, Krzyśko M, Waszak Ł, Wołyński W. Selected statistical methods of data analysis for multivariate functional data. Stat Pap. 2018 Mar; 59(1): 153-82.

Alheety MI. New versions of liu-type estimator in weighted and non-weighted mixed regression model. Baghdad Sci J. 2020 Mar 18; 17(1 (Suppl.)): 0361-.

Ferraty F, Vieu P. Nonparametric functional data analysis: theory and practice. SSBM. springer series in statistic. 2006 https://books.google.iq/books/about/Nonparametric_Functional_Data_Analysis.html?id=lMy6WPFZYFcC&printsec=frontcover&source=kp_read_button&hl=en&redir_esc=y.

Ferraty F, Vieu P. Nonparametric models for functional data, with application in regression, time series prediction and curve discrimination. J Nonparametr Stat. 2004 Feb 1; 16(1-2): 111-25.

Chowdhury J, Chaudhuri P. Nonparametric depth and quantile regression for functional data. Bernoulli. 2019 Feb; 25(1): 395-423.

Ahmed MS, N'diaye M, Attouch MK, Dabo-Niang S. k-nearest neighbors prediction and classification for spatial data. arXiv preprint arXiv:1806.00385. 2018 Jun 1.

Dai W, Genton MG. Multivariate functional data visualization and outlier detection. J Comput Graph Stat . 2018 Oct 2; 27(4): 923-34.

Doori A. Hazard Rate Estimation Using Varying Kernel Function for Censored Data Type I. Baghdad Sci J. 2019 Sep 23; 16(3 (Suppl.)): 0793-.

Lam KK, Wang B. Robust non-parametric mortality and fertility modelling and forecasting: Gaussian process regression approaches. Forecasting 2021; 3(1): 207-227; https://doi.org/10.3390/forecast3010013

Chaouch M, Laïb N. Nonparametric multivariate L_1-median regression estimation with functional covariates. Electron. 2013 ; 7: 1553-1586.

Wang B, Chen T, Xu A. Gaussian process regression with functional covariates and multivariate response. Chemometr Intell Lab Syst. 2017; Apr; 163: 1-6.

Xiang D, Qiu P, Pu X. Nonparametric regression analysis of multivariate longitudinal data. Stat Sin. 2013 Apr 1: 769-89.

Omar KM, Wang B. Nonparametric regression method with functional covariates and multivariate response. Commun Stat Theory Methods. 2019 Jan 17; 48(2): 368-80.

Sugianto S, Rusdi M. Functional Data Analysis: An Initiative Approach for Hyperspectral Data. J Phys Conf Ser. 2019 Nov 1; 1363(1) : 012087.

Shang HL. Bayesian bandwidth estimation and semi-metric selection for a functional partial linear model with unknown error density. J Appl Stat. 2021 Mar 12; 48(4): 583-604.

Rinnan R, Rinnan Å. Application of near infrared reflectance (NIR) and fluorescence spectroscopy to analysis of microbiological and chemical properties of arctic soil. Soil Biol Biochem. 2007 Jul 1; 39(7): 1664-73.