K-Nearest Neighbor Method with Principal Component Analysis for Functional Nonparametric Regression
Main Article Content
Abstract
This paper proposed a new method to study functional non-parametric regression data analysis with conditional expectation in the case that the covariates are functional and the Principal Component Analysis was utilized to de-correlate the multivariate response variables. It utilized the formula of the Nadaraya Watson estimator (K-Nearest Neighbour (KNN)) for prediction with different types of the semi-metrics, (which are based on Second Derivative and Functional Principal Component Analysis (FPCA)) for measureing the closeness between curves. Root Mean Square Errors is used for the implementation of this model which is then compared to the independent response method. R program is used for analysing data. Then, when the covariates are functional and the Principal Component Analysis was utilized to de-correlate the multivariate response variables model, results are more preferable than the independent response method. The models are demonstrated by both a simulation data and real data.
Received 6/7/2021
Accepted 23/8/2022
Published Online First 25/11/2022
Article Details
This work is licensed under a Creative Commons Attribution 4.0 International License.
How to Cite
References
Ramsay JO, Silverman BW . Functional Data Analysis. 2nd Ed., Springer, New York. 2005. https://link.springer.com/book/10.1007/b98888
Cao G, Wang S, Wang L. Estimation and inference for functional linear regression models with partially varying regression coefficients. Stat. 2020; 9(1): e286.
Klepsch J, Klüppelberg C. An innovations algorithm for the prediction of functional linear processes. J Multivar Anal. 2017 Mar 1; 155: 252-71.
Chiou J M, Müller H G, Wang J L. Functional response models. Stat Sin. 2004: 675–693.
Wang B, Xu A. Gaussian process methods for nonparametric functional regression with mixed predictors. Comput Stat Data Anal. 2019 Mar 1; 131: 80-90.
Górecki T, Krzyśko M, Waszak Ł, Wołyński W. Selected statistical methods of data analysis for multivariate functional data. Stat Pap. 2018 Mar; 59(1): 153-82.
Alheety MI. New versions of liu-type estimator in weighted and non-weighted mixed regression model. Baghdad Sci J. 2020 Mar 18; 17(1 (Suppl.)): 0361-.
Ferraty F, Vieu P. Nonparametric functional data analysis: theory and practice. SSBM. springer series in statistic. 2006 https://books.google.iq/books/about/Nonparametric_Functional_Data_Analysis.html?id=lMy6WPFZYFcC&printsec=frontcover&source=kp_read_button&hl=en&redir_esc=y.
Ferraty F, Vieu P. Nonparametric models for functional data, with application in regression, time series prediction and curve discrimination. J Nonparametr Stat. 2004 Feb 1; 16(1-2): 111-25.
Chowdhury J, Chaudhuri P. Nonparametric depth and quantile regression for functional data. Bernoulli. 2019 Feb; 25(1): 395-423.
Ahmed MS, N'diaye M, Attouch MK, Dabo-Niang S. k-nearest neighbors prediction and classification for spatial data. arXiv preprint arXiv:1806.00385. 2018 Jun 1.
Dai W, Genton MG. Multivariate functional data visualization and outlier detection. J Comput Graph Stat . 2018 Oct 2; 27(4): 923-34.
Doori A. Hazard Rate Estimation Using Varying Kernel Function for Censored Data Type I. Baghdad Sci J. 2019 Sep 23; 16(3 (Suppl.)): 0793-.
Lam KK, Wang B. Robust non-parametric mortality and fertility modelling and forecasting: Gaussian process regression approaches. Forecasting 2021; 3(1): 207-227; https://doi.org/10.3390/forecast3010013
Chaouch M, Laïb N. Nonparametric multivariate L_1-median regression estimation with functional covariates. Electron. 2013 ; 7: 1553-1586.
Wang B, Chen T, Xu A. Gaussian process regression with functional covariates and multivariate response. Chemometr Intell Lab Syst. 2017; Apr; 163: 1-6.
Xiang D, Qiu P, Pu X. Nonparametric regression analysis of multivariate longitudinal data. Stat Sin. 2013 Apr 1: 769-89.
Omar KM, Wang B. Nonparametric regression method with functional covariates and multivariate response. Commun Stat Theory Methods. 2019 Jan 17; 48(2): 368-80.
Sugianto S, Rusdi M. Functional Data Analysis: An Initiative Approach for Hyperspectral Data. J Phys Conf Ser. 2019 Nov 1; 1363(1) : 012087.
Shang HL. Bayesian bandwidth estimation and semi-metric selection for a functional partial linear model with unknown error density. J Appl Stat. 2021 Mar 12; 48(4): 583-604.
Rinnan R, Rinnan Å. Application of near infrared reflectance (NIR) and fluorescence spectroscopy to analysis of microbiological and chemical properties of arctic soil. Soil Biol Biochem. 2007 Jul 1; 39(7): 1664-73.