Solve Autoregressive Model Problem

  • MHB
  • Thread starter Fernando Revilla
  • Start date
  • Tags
    Model
In summary, the conversation discusses a problem in which the population of three cities in a country remains constant but people move between the cities each year. An algebraic approach is used to predict the population ratios in the future, and it is determined that the population ratios correspond to the eigenvector belonging to eigenvalue 1. The conversation also raises the question of whether this problem can be solved analytically without trial and error.
  • #1
Fernando Revilla
Gold Member
MHB
631
0
I quote an unsolved problem from another forum (Algebra) posted on January 16th, 2013.

Got the following problem.

In a country you can live in three different citys, A, B and C, the population is constant.

Each year;

70% of the residents in city A stay, 20% move to city B and 10% move to city C
90% of the residents in city B stay, 5% move to city A and 5% move to city C
50% of the residents in city C stay, 45% move to city A and 5% move to city B

I am suppose to explain this as an autoregressive process.
Through some datamining i found that the process is an AR(3) process, with coefficents
2,1 -1.3725 0.2725

My question is, is it possible to solve this analytically, without Least squares trial and error?

I provide an algebraic approach to predict the behaviour in the future.

Denote [tex]P_{n}=(a_n,b_n,c_n)^t[/tex], where [tex]a_n,b_n,c_n[/tex] are the poblations of [tex]A,B,C[/tex] respectively in the year [tex]n[/tex]. According to the hypothesis:

[tex]a_n=0.7a_{n-1}+0.05b_{n-1}+0.45c_{n-1}\\b_n=0.2a_{n-1}+0.9b_{n-1}+0.05c_{n-1}\\c_n=0.1a_{n-1}+0.05b_{n-1}+0.5c_{n-1}[/tex]

Equivalently

[tex]P_n=\begin{bmatrix}{0.7}&{0.05}&{0.45}\\{0.2}&{0.9}&{0.05}\\{0.1}&{0.05}&{0.5}\end{bmatrix}\;P_{n-1}=\dfrac{1}{20}\begin{bmatrix}{70}&{5}&{45}\\{20}&{90}&{5}\\{10}&{5}&{50}\end{bmatrix}\;P_{n-1} =MP_{n-1}[/tex]

Then, [tex]P_n=MP_{n-1}=M^2P_{n-2}=\ldots=M^nP_0[/tex]

As [tex]M[/tex] is a Markov matrix, has the eigenvalue [tex]\lambda_1=1[/tex] and easily we can find the rest: [tex]\lambda_2=(11+\sqrt{3})/20[/tex] and [tex]\lambda_3=(11-\sqrt{3})/20[/tex]. These eigenvalues are all simple, so [tex]M[/tex] is diagonalizable in [tex]\mathbb{R}[/tex]. If [tex]Q\in\mathbb{R}^{3\times 3}[/tex] satisfies [tex]Q^{-1}AQ=D=\mbox{diag }(\lambda_1,\lambda_2,\lambda_3)[/tex], then [tex]P_n=QD^nQ^{-1}P_0[/tex]. Taking limits in both sides an considering that [tex]|\lambda_2|<1[/tex] and [tex]|\lambda_3|<1[/tex]:

[tex]P_{\infty}:=\displaystyle\lim_{n \to \infty} P_n=Q\;(\displaystyle\lim_{n \to \infty}D^n)\;Q^{-1}P_0=Q\;\begin{bmatrix}{1}&{0}&{0}\\{0}&{0}&{0}\\{0}&{0}&{0}\end{bmatrix}\;Q^{-1}P_0[/tex]

Not that for computing [tex]P_{\infty}[/tex] we only need the first column (an eigenvalue [tex]v_1[/tex] associated to [tex]\lambda_1[/tex]) of [tex]Q[/tex] and the first row [tex]w_{1}[/tex] of [tex]Q^{-1}[/tex]. We get [tex]v_1=(19,42,8)^t[/tex] and [tex]w_{1}=(1/69)(1,1,1)[/tex]. So,
$P_{\infty}=\begin{bmatrix}a_{\infty} \\ b_{\infty}\\ c_{\infty}\end{bmatrix}=$ $\dfrac{1}{69}\begin{bmatrix}{19}&{*}&{*} \\ {42}&{*}&{*} \\ {8}&{*}&{*}\end{bmatrix}\;\begin{bmatrix}{1}&{0}&{0} \\ {0}&{0}&{0} \\ {0}&{0}&{0}\end{bmatrix}\;$ $\begin{bmatrix}{1}&{1}&{1}\\{*}&{*}&{*}\\{*}&{*}&{*}\end{bmatrix}\begin{bmatrix}a_{0}\\b_{0}\\c_{0}\end{bmatrix}=$ $\dfrac{1}{69}\begin{bmatrix}{19(a_0+b_0+c_0)}\\{42(a_0+b_0+c_0)}\\{8(a_0+b_0+c_0)}\end{bmatrix}$

which represents the tendency of the poblations of [tex]A,B[/tex] and [tex]C[/tex] as [tex]n\to \infty[/tex].
 
Physics news on Phys.org
  • #2
Hmm, since it is given that the population remains constant, doesn't it suffice that:
$P_1 = P_0$​

That is,
$MP_0 = P_0$​

So the population ratios correspond to the eigenvector belonging to eigenvalue 1?
 
  • #3
ILikeSerena said:
Hmm, since it is given that the population remains constant, doesn't it suffice that: $P_1 = P_0$

Remains constant means $a_n+b_n+c_n=a_{n-1}+b_{n-1}+c_{n-1}$ for all $n\geq 1$, different from $(a_n,b_n,c_n)=(a_{n-1}b_{n-1},c_{n-1})$.
 

FAQ: Solve Autoregressive Model Problem

1. What is an autoregressive model and what problem does it solve?

An autoregressive model is a statistical method used to analyze time-series data, where the current value of a variable is predicted based on its past values. It solves the problem of identifying and predicting patterns or trends in a time series, making it useful for forecasting future values.

2. How do you determine the order of an autoregressive model?

The order of an autoregressive model refers to the number of lagged values used in the model. It can be determined by looking at the autocorrelation function (ACF) plot of the time series data. The ACF plot shows the correlation between a variable's current value and its past values at different lags. The order of the model is typically chosen based on the lag at which the correlation is significant.

3. What is the difference between autoregressive and moving average models?

Autoregressive (AR) models use past values of a variable to predict its current value, while moving average (MA) models use past prediction errors to forecast future values. Additionally, AR models assume that the current value of a variable is dependent on its past values, while MA models assume that the current value is related to random shocks or errors from previous predictions.

4. How do you evaluate the performance of an autoregressive model?

The performance of an autoregressive model can be evaluated by comparing its predicted values with the actual values of the time series data. This can be done by calculating metrics such as mean squared error (MSE), root mean squared error (RMSE), and mean absolute error (MAE). A lower value of these metrics indicates better performance of the model.

5. Can an autoregressive model handle non-stationary data?

No, autoregressive models are designed for stationary time series data, where the mean and variance of the data remain constant over time. If the data is non-stationary, it needs to be transformed or differenced before an autoregressive model can be applied. Also, the model's performance may be affected by non-stationarity, so it is important to check and address this issue before using an autoregressive model.

Similar threads

Replies
5
Views
2K
Replies
15
Views
1K
Replies
1
Views
892
Replies
4
Views
2K
Replies
2
Views
1K
Replies
1
Views
964
Replies
8
Views
3K
Back
Top