## TS Module 7 ARIMA means variances

 Author Message NEAS Supreme Being         Group: Administrators Posts: 4.2K, Visits: 1.2K TS Module 7 Stationary mixed processes(The attached PDF file has better formatting.)Time Series Practice Problems ARMA Means and VariancesARMA processes have autoregressive parameters Nj, moving average parameters 2j, aconstant * or 20, and a standard error F . We derive 2! Means and variances of the Yt terms and an autocorrelation function.! Forecasts with their standard errors and confidence intervals.The practice problems here cover means and variances of the time series. Other sets ofpractice problems show how to work more complex items.The textbook shows all the relations tested on the final exam and used in the studentprojects. As you review the modules, work through the derivations of each result. Therelations follow directly from first principles.The final exam problems emphasize the intuition. An exam problem might give the meanor variance of the time series and back into a coefficient. If you understand howautoregressive and moving average parameters affect the means, forecasts, variances,and standard errors, the problems are straight-forward.*Question 7.1: Mean of ARMA ProcessAn ARMA(p,q) process is Yt = 3 + ,t + moving average parameters 2j = 0.5 for j = 1 to 4 jand autoregressive parameters Nk = 0.366 for k = 1 to 2. Note that the constant term is k3. What is the mean of this time series?A. 2B. 4C. 6D. 8E. 10Answer 7.1: CThe constant term is called 20 in the Cryer and Chan textbook. Other authors use * or ".The constant term causes a displacement, not a change in the time series pattern.Intuition: If all observed terms are the mean and all residuals are zero, the forecast of thenext term is the mean. Substitute : for the Y terms and 0 for the , terms, giving a linearequation in one unknown :.For this exercise, : = 3 + : × (0.3661 +0.3662) + 0 × (terms with 2)The mean : of this process is : = 3 / (1 – 3Nj) = 3 / (1 – 0.366 – 0.366 ) = 5.999 2The textbook has two ways of writing an ARMA process:! Using terms of (Yt – :), with no constant term.! Using terms of Yt, with a constant term.They are equivalent.*Question 7.2: Mean of ARMA ProcessAn ARMA(p,q) process is Yt = 3 + ,t + moving average parameters 2j = 0.5 for j = 1 to 4 jand autoregressive parameters Nk = 0.366 for k = 1 to 2. All values for t < 10 were the kmean, and all residuals were zero.If the actual value y10 = 3, what is the expected value of y11?A. 3.0B. 3.3C. 3.6D. 6.0E. 6.4Answer 7.2: E! The residuals for t < 10 are zero (by the assumptions).! The expected value for t = 10 is the mean; work out the residual for t = 10.The moving average coefficient = the negative of the moving average parameter.The mean : of this ARMA process is : = 3 / (1 – 3Nj) A: = 3 / (1 – 0.366 – 0.3662) = 5.999! The residual for y10, or ,10, is 3 – 6 = –3.! The expected value of y11 = 3 + 0.366 × 3 + 0.366 × 6 – 0.5 × (–3) = 6.402 2*Question 7.3: Mean of ARMA ProcessAn ARMA(p,q) process has moving average parameters 2j = 0.5 for j = 1 to 4 and jautoregressive parameters Nk = 0.366 for k = 1 to 2. The parameter * = 5. What is the kmean of this time series?A. 7B. 8C. 9D. 10E. 11Answer 7.3: DThe formula relating : and * for an autoregressive process is : = * / (1 – 3Nj) A: = 5 / (1 – 0.366 – 0.3662) = 9.999To verify, we assume all past values are the mean of 10 and all past residuals are zero.The next value is expected to be 5 + 0.366 × 10 + 0.3662 × 10 = 10.000 .*Question 7.4: Mean of ARMA ProcessAn ARMA(p,q) process has moving average parameters 2j = 0.5 for j = 1 to 4 and jautoregressive parameters Nk = 0.366 for k = 1 to 2. The parameter * = 5. Assume that kall values for t < 10 were the mean, and all residuals were zero.If y10 = 9, what is the expected value of y11? We worked out the mean in the previousproblem, which gives the values for y9 and y8. The residuals for t # 9 are zero (by theassumptions). The expected value for t = 10 is the mean, from which we work out theresidual for t = 10. The convention in the textbook is that the moving average coefficientis the negative of the moving average parameter.A. 8B. 9C. 10D. 11E. 12Answer 7.4: CThe residual for y10, or ,10, is 9 – 10 = –1.The expected value of y11 = 5 + 0.366 × 9 + 0.366 × 10 – 0.5 × (–1) = 10.005 2*Question 7.5: ARMA MeanWe use an ARMA(3,1) model to forecast a time series:The mean of this time series is 9. What is the constant term * of the time series?A. –2.70B. –2.25C. –1.20D. +2.25E. +2.70Answer 7.5: ECryer and Chan use the variable 20 instead of *. The discussion forum postings use 20,*, or ". The final exam problems may derive the constant term, the mean, or oneautoregressive parameter. The solution is straight-forward.The mean is the constant term * divided by (1 – 3Nj). The autoregressive coefficientsaffect the mean; the moving average coefficients do not affect the mean.j j : = * / (1 – 3N) A * = : × (1 – 3N) = 9 × (1 – 0.3 – 0.2 – 0.2) = 2.700*Question 7.6: AR(1) ProcessWe use a time series process to model a sequence of values:What is the mean of this process?A. 3B. 6C. –6D. 12E. The time series is not stationary and has no meanAnswer 7.6: EIf the absolute value of the N1 coefficient is more than or equal to one, the time series hasno mean (is not stationary). For higher order processes, the conditions for stationarity aremore complex.Jacob: Why does the time series have no mean? Suppose N1 is a negative number lessthan or equal to –1. Why can’t we use the formula : = * / (1 – N1)?Rachel: Suppose N1 is –2 and y1 is zero. The formula : = * / (1 – N1) = 6 / (1 – –2) = 2.The expected values of the next entries are +6, –6, +18, –30, +66, and so forth. Theexpected values assume , = 0.The values oscillate about 2, but they move away from 2; they don’t approach 2.Jacob: What if N1 = –1, as in the practice problem here?Rachel: The formula gives : = * / (1 – N1) = 6 / (1 – –1) = 3.The expected values of the next entries are +6, 0, +6, 0, +6, 0, and so forth.The values oscillate about 3, but they don’t converge or diverge. The series has no mean.Take heed: The mean : is the expected value as t ÿ 4. Even if an error term , moves thetime series away from this mean for a few periods, later values come back to the mean.In this time series, if a random fluctuation moves the process away from 3, later terms donot revert to 3.*Question 7.7: AR(1) ProcessWe use an time series process to model a sequence of values:What is (0, the variance of yt?A. 4B. 6C. 8D. 12E. The time series is not stationary and has no finite variance.Answer 7.7: EThe N1 coefficient is greater in absolute value than one. The uncertainty in the forecastsincreases without bound as the number of periods ahead increases. The variance of yt islike the variance of the forecast for an infinite number of periods ahead.Jacob: Is the variance of Yt the same as the variance of the error term?Rachel: Distinguish the variance of the error term and the variance of the Y terms.Suppose we know the past terms of the time series and we must estimate the next value.! The value is stochastic, so we do not know it with certainty.! We estimate the distribution of this value.! The distribution is normal with a variance F2.Suppose we do not know any past terms of the time series and we estimate the next value.! The mean of the distribution depends on the past values." For an AR(1) process, it depends on one past value.! For other ARMA processes, it may depend on several past values." Each unknown value adds uncertainty and increases the variance of the estimate." We combine the various sources of uncertainty.If the variances of the sources are independent, we add them. Some sources ofuncertainty are correlated, such as autoregressive and moving average parameters for thesame period.In an ARMA(1,1) process, the uncertainty is perfectly correlated. We add theautoregressive and moving average coefficients (i.e., subtract the parameters).Think of the variances in a continuum.! The variance of the one period ahead forecast is the variance of the error term.! The variance of the l period ahead forecast as l ÿ 4 is the variance of Yt.! In between are the variance of other forecasts.*Question 7.8: AR(1) ProcessWe use an AR(1) process (autoregressive of order 1) to model a time series:, with F2 = 21.What is (0, the variance of yt?A. 2.1B. 7C. 21D. 25E. 49Answer 7.8: D21 / (1 – 0.42) = 25.000This is not the variance of the forecast, which assumes we know the past values. This isthe variance of the time series value itself.Each Yt is the sum of two random variables: ,t and 0.4yt-1. In an autoregressive process,yt depends on the lagged values, but the residuals are independent of the lagged values.You can solve this problem by the formula in the textbook or by intuition. The intuition isthat the variance is the same for all elements of the time series. The variance of yt equalsthe variance of yt-1. Form an equation for the relation of the variances from the time seriesequation Var(yt) = 0.4 × Var(yt-1) + 0 + F 2 2Jacob: In the regression analysis course, the variance of Y is the variance of the error term.Why is that not true here?Rachel: In the regression analysis course, Y is a function of X, which is not a randomvariable. In an autoregressive time series, Yt is a function of Yt-1, which is a randomvariable.*Question 7.9: Moving Average Model of Period NA time series follows a moving average model of period N:What is the mean of this time series?A. ½B. 1C. 1 + 1/ND. 2E. The time series is not stationary and does not have a meanAnswer 7.9: BFor a moving average process, : = * = 20 = 1 (in this problem).The mean does not depend on the moving average parameters.*Question 7.10: Moving Average Model of Period NA time series follows a moving average model of period N:What is the variance of this time series?A. 1B. (N + 1)/N = 1 + 1/NC. (N + 1)2/N2D. 2E. The time series is not stationary and does not have a varianceAnswer 7.10: BFor a moving average process, the residuals are independent and have the same variance.! The variance of the sum of the residuals is the sum of the variances.! The variance of "Y, where " is a scalar and Y is a random variable, is "2 × variance(Y).A moving average process is stationary if the sum of the moving average parameters isfinite.The variance is F2 × (1 + N × 1/N2) = 1 × (1 + 1/N) = 1 + 1/N Attachments TS fex pps ARIMA means.variances df.pdf (1.8K views, 125.00 KB) Alan Forum Newbie         Group: Forum Members Posts: 9, Visits: 1 about the first post there, I still don't get why it is 6. I understand that without the problem giving us y10=3, then E(y9)=6, but since it gives us y10, it is a conditional expectation, and y9 and y10 are not independent and therefore y9 should be a number different from 6. Can someone help? RayDHIII Forum Member         Group: Forum Members Posts: 39, Visits: 138 Yt = mu for t<10 is given to us by "All values for t<10 were the mean, and all residuals were zero."So, Y1 = Y2 = ... = Y8 = Y9 = mu (the solution shows how to find this)The expected value of Y11 expects e11 to be zero, thusY11 = 3 + .366Y10 + .3662Y9 - .5e10 We are given Y10 and Y9, and e10 = Y10 - Y9, and so the answer easily follows.RDH CalLadyQED Forum Guru         Group: Forum Members Posts: 62, Visits: 2 For #7.4, is the final answer actually 10.13356? EmilyJ Forum Newbie         Group: Forum Members Posts: 1, Visits: 1 That's what I get. Nezzie Forum Newbie         Group: Forum Members Posts: 5, Visits: 1 I am wondering if the formula that is used in the above problems to find the mean of an ARMA process is in the textbook?  I have been looking through the module 7 reading and I do not see where the textbook relates the mean of an ARMA process to the constant term and the autoregressive parameters.Any help on where they discuss this or if this is something we are expected to work out on our own would be helpful, thanks.[NEAS: See equations 5.3.16 and 5.3.17 on page 97. Cryer and Chan dont show these equations until Chapter 5; most other texts on time series discuss these equations much earlier.]
##### Merge Selected
Merge into selected topic...

Merge into merge target...

Merge into a specific topic ID...