Statistics and Its Interface

Volume 16 (2023)

Number 2

Special issue on recent developments in complex time series analysis – Part II

Guest editors: Robert T. Krafty (Emory Univ.), Guodong Li (Univ. of Hong Kong), Anatoly Zhigljavsky (Cardiff Univ.)

Smooth online parameter estimation for time varying VAR models with application to rat local field potential activity data

Pages: 227 – 257

DOI: https://dx.doi.org/10.4310/22-SII729

Authors

Anass El Yaagoubi Bourakna (Statistics Program, King Abdullah University of Science and Technology, Thuwal, Saudi Arabia)

Marco Pinto (Oslo Metropolitan University, Oslo, Norway)

Norbert Fortin (University of California, Irvine, Calif., U.S.A.)

Hernando Ombao (Statistics Program, King Abdullah University of Science and Technology, Thuwal, Saudi Arabia)

Abstract

Multivariate time series data appear often as realizations of non-stationary processes where the covariance matrix or spectral matrix smoothly evolve over time. Most of the current approaches estimate the time-varying spectral properties only retrospectively – that is, after the entire data has been observed. Retrospective estimation is a major limitation in many adaptive control applications where it is important to estimate these properties and detect changes in the system as they happen in real-time. To overcome this limitation, we develop an online estimation procedure that gives a real-time update of the time-varying parameters as new observations arrive. One approach to modeling nonstationary time series is to fit time-varying vector autoregressive models (tv-VAR). However, one major obstacle in online estimation of such models is the computational cost due to the high-dimensionality of the parameters. Existing methods such as the Kalman filter or local least squares are feasible. However, they are not always suitable because they provide noisy estimates and can become prohibitively costly as the dimension of the time series increases. In our brain signal application, it is critical to develop a robust method that can estimate, in real-time, the properties of the underlying stochastic process, in particular, the spectral brain connectivity measures. For these reasons we propose a new smooth online parameter estimation approach (SOPE) that has the ability to control for the smoothness of the estimates with a reasonable computational complexity. Consequently, the models are fit in real-time even for high dimensional time series.We demonstrate that our proposed SOPE approach is as good as the Kalman filter in terms of mean-squared error for small dimensions. However, unlike the Kalman filter, the SOPE has lower computational cost and hence scalable for higher dimensions. Finally, we apply the SOPE method to local field potential activity data from the hippocampus of a rat performing an odor sequence memory task. As demonstrated in the video, the proposed SOPE method is able to capture the dynamics of the connectivity as the rat samples the different odor stimuli.

Keywords

online parameter estimation, locally stationary processes, dynamic brain connectivity, dynamic spectral connectivity

Received 26 March 2021

Accepted 14 February 2022

Published 13 April 2023