Evaluating non-linear models on point and interval forecasts: an application with exchange rates
DOI:
https://doi.org/10.13133/2037-3643/9837Keywords:
Exchange RatesAbstract
The aim of this paper is to compare the forecasting performance of SETAR and GARCH models against a linear benchmark using historical data for two bilateral dollar exchange rates, namely the Japanese Yen and the British Pound. The analysis is carried out with series sampled at weekly and daily frequencies. The relative performance of the models is evaluated on point forecasts and interval forecasts. Point forecasts evaluation tends to favour on average the linear models, though the analysis produces some evidence of forecasting gains from nonlinear models in sub-samples characterised by stronger non-linearity. Evaluation of interval forecasts clearly favours the GARCH models and shows that they are more accurate than the AR and SETAR models, especially at forecasting events in the tail regions of the distribution.
JEL Codes: F31, F37
References
BOERO, G. and E. MARROCU (2000), "Modelli non lineari per i tassi di cambio: un confronto previsivo con dati a diversa frequenza", Moneta e Credito, vol. 53, pp. 385-415.
BOERO G. and E. MARROCU (2002), "The performance of nonlinear exchange rate models: a forecast comparison", Journal of Forecasting, vol. 21, pp. 513-42.
BOERO G. and E. MARROCU (2004), "The performance of SETAR models: a regime conditional evaluation of point, interval and density forecasts", International Journal of Forecasting, vol. 20, pp. 305-20.
BOLLERSLEV, T. (1986), "Generalized autoregressive conditional heteroscedasticity", Journal of Econometrics, vol. 31, pp. 307-27.
CHRISTOFFERSEN, P. (1998), "Evaluating interval forecasts", International Economic Review, vol. 39, pp. 841-62.
CLARÍDA, R.H., L. SARNO, M.P. TAYLOR and G. VALENTE (2003), "The out-of-sample success of term structure models as exchange rate predictors: a step beyond", Journal of International Economics, vol. 60, pp. 61-83.
CLEMENTS, M.P. and J.P. SMITH (1999), "A Monte Carlo study of the forecasting performance of empirical SETAR models", Journal of Applied Econometrics, vol. 14, pp. 123-41.
CLEMENTS M.P. and J.P. SMITH (2001), "Evaluating forecasts from SETAR models of exchange rates", Journal of International Money and Finance, vol. 20, pp. 133-48.
CLEMENTS, M.P., P.H. FRANSES, J.P. SMITH and D. VAN DIJK (2003), "On SETAR non-linearity and forecasting, Journal of Forecasting, vol. 22, pp. 359-75.
DACCO, R. and S. SATCHELL (1999), "Why do regime-switching models forecast so badly?", Journal of Forecasting, vol. 18, pp. 1-16.
DIEBOLD, F.X. and R.S. MARIANO (1995), "Comparing predictive accuracy", Journal of Business and Economic Statistics, vol. 13, pp. 253-63.
DIEBOLD, F.X. and J.A. NASON (1990), "Nonparametric exchange rate prediction?", Journal of International Economics, vol. 28, pp. 315-32.
ENGEL C. (1994), "Can the Markov switching model forecast exchange rate?", Journal of International Economics, vol. 36, pp. 151-65.
ENGEL C. and J.D. HAMILTON (1990), "Long swings in the dollar: are they in the data and do markets know it?", American Economic Review, vol. 80, pp. 689-713.
ENGLE, R.F. (1982), "Autoregressive conditional heteroscedasticity with estimates of the variance of the United Kingdom inflation", Econometrica, vol. 50, pp. 987-1008.
FILDES, R. (1992), "The evaluation of extrapolative forecasting methods", International Journal of Forecasting, vol. 8, pp. 81-98.
GRANGER C.W.J and T. TERÄSVIRTA (1993), Modelling Nonlinear Economic Relationships, Oxford University Press, Oxford.
HAMILTON, J.D. (1989), "A new approach to the economic analysis of nonstationary time series and the business cycle", Econometrica, vol. 57, pp. 357-84.
HSIEH, D.A. (1989), "A nonlinear stochastic rational expectations model of exchange rates", Fuqua School of Business, Duke University, unpublished manuscript.
KRÄGER, H. and P. KUGLER (1993), "Nonlinearities in foreign exchange markets: a different perspective", Journal of International Money and Finance, vol. 12, pp. 195-208.
LUUKKONEN, R., P. SAIKKONEN and T. TERÄSVIRTA (1988), "Testing linearity in univariate time series models", Scandinavian Journal of Statistics, vol. 15, pp. 161-75.
MARK, N.C. and D. SUL (2001), "Nominal exchange rates and monetary fundamentals: evidence from a small post-Bretton Woods panel", Journal of International Economics, vol. 53, pp. 29-52.
MEESE R. and K. ROGOFF (1983), "Empirical exchange rate models of the seventies: do they fit out of sample?", Journal of International Economics, vol. 14, pp. 3-24.
MEESE, R.A. and A.K. ROSE (1991), "An empirical assessment of nonlinearities in models of exchange rate determination", Review of Economic Studies, vol. 58, pp. 603-19.
NELSON, D.B. (1991), "Conditional heteroskedasticity in asset returns: a new approach", Econometrica, vol. 59, pp. 347-70.
PEEL, D.A. and A.E. SPEIGHT (1994), "Testing for nonlinear dependence in inter-war exchange rates", Weltwirtschaftliches Archiv, Bd. 130, pp. 391-417.
POTTER, S. (1995), "A nonlinear approach to US GNP", Journal of Applied Econometrics, vol. 10, pp. 109-25.
PRIESTLEY, M.B. (1988), Nonlinear and Non-stationary Time Series Analysis, Academic Press, London.
RYDEN, T., T. TERÄSVIRTA and S. ASBRINK (1998), "Stylised facts of daily returns series and the hidden Markov model", Journal of Applied Econometrics, vol. 13, pp. 217-44.
TASHMAN, L.J. (2000), "Out-of-sample tests of forecasting accuracy: an analysis and review", International Journal of Forecasting, vol. 16, pp. 437-50.
TIAO G.C. and R.S. TSAY (1994), "Some advances in non-linear and adaptive modeling in time series", Journal of Forecasting, vol. 13, pp. 109-31.
TONG H. (1978), "On a threshold model. In pattern recognition and a signal processing", in C.H. Chen ed., Pattern Recognition and Signal Processing, Sijhoff and Noordoff, Amsterdam, pp. 101-41.
TONG, H. (1983), Threshold Models in Nonlinear Time Series Analysis, Springer-Verlag, New York.
TONG, H. (1995), Non-linear Time Series. A Dynamical System Approach, Clarendon Press, Oxford.
TONG, H. and K.S. LIM (1980), "Thresholds autoregression, limit cycles and cyclical data", Journal of the Royal Statistical Society B, vol. 42, pp. 245-92.
ZAKOIAN, J.M. (1994), "Threshold heteroskedastic models", Journal of Economic Dynamics and Control, vol. 18, pp. 931-55.