Solved – the rationale for using Univariate Time Series modelling

Usually when creating a regression model using cross sectional data we assume a dependent and independent variable.

but in AR,MA, ARMA and ARIMA models forecast based on the previous periods values or disturbance terms.

What is the rationale for univariate time series modelling and why would one prefer to use a univariate forecast as opposed to a multiple variable one?

You have two distinct questions in your post:

  • Why use univariate models? and
  • Why use forecasts from univariate models?

I will give several answers that fit both of the above and then another answer that only addresses the former.

A forecast based on a univariate time series may be preferred over a forecast based on a multivariate time series in the following cases:

  1. You only observe one time series $y_t$. Here you do not have a choice. Clearly, only a univariate model can deliver a feasible forecast.
  2. You observe a multivariate time series $(y_t,X_t)$ where $X_t$ may be univariate or multivariate, but $X_t$ do not have any influence on $y_t$. Including $X_t$ in the model only introduces noise in your forecasts and hence makes them less accurate.
  3. You observe a multivariate time series $(y_t,X_t)$ where $X_t$ may be univariate or multivariate, and $X_t$ does have some influence on $y_t$. However, the influence is too small to be measured and/or modelled accurately. Then including $X_t$ in the model introduces more noise than signal, leading to poorer forecasts.

    This is a matter of signal to noise ratio and the sample size. The smaller the ratio and the sample size, the less grounds there are for choosing a multivariate model over a univariate one. This is also what Aksakal talks about in his answer.

  4. Forecasting needs to be done fast. Multivariate models generally take longer to estimate than their univariate counterparts due to the increased complexity. Speed can be important when you have to react to new information very quickly (such as in some forms of trading on the financial markets) or need to process large amounts of data (thousands or millions of time series).
  5. The multivariate counterpart of the univariate model is too complex to estimate. This may be true for ARIMA models when the dimension of $X_t$ is relatively high. Univariate ARIMA models are moderately hard to estimate, but multivariate ones have a notoriously high apetite for computational resources. Thus sometimes estimating a multivariate model and producing forecasts from it is infeasible while there are no problems with the univariate model and its forecasts.

Regarding modelling for other purposes than forecasting, all of the above still holds true by substituting "forecasts" with "coefficient estimates". Moreover,

  1. You may be interested in projecting the behaviour of a time series only on its own past but not on any other series. Thus you are not interested in causal modelling or representing the true relationships among all the variables available to you but rather in visualizing how a single series develops in its own historical perspective. Then a univariate model is preferable.

P.S. Most of the discussion above applies not only in the time series setting but also more generally.

Similar Posts:

Rate this post

Leave a Comment