多元回归分析：渐进性 y = b0 + b1x1 + b2x bkxk + u

Presentation on theme: "多元回归分析：渐进性 y = b0 + b1x1 + b2x bkxk + u"— Presentation transcript:

1 多元回归分析：渐进性 y = b0 + b1x1 + b2x2 + . . . bkxk + u
Copyright © 2007 Thomson Asia Pte. Ltd. All rights reserved.

2 渐进性的含义 如果误差并非正态分布，对任何的样本容量而言，t统计量、F统计量并非恰好服从t分布、F分布。
计量经济学导论 刘愿

3 一致性 在高斯-马尔科夫假定下，OLS估计是最优线性无偏的，但我们并非总能得到无偏的估计量。
一致性是对一个估计量最起码的要求。在无法满足无偏性的情况下，我们可以搜集尽可能多的样本，即使n→ ∞,参数估计值的分布将逼近真实参数值。 计量经济学导论 刘愿

4 一致性的正式定义 计量经济学导论 刘愿

5 一致性的直观理解 计量经济学导论 刘愿

6 当样本容量增加时的样本分布 计量经济学导论 刘愿

7 计量经济学导论 刘愿

8 OLS的一致性 在高斯-马尔科夫假定下，OLS估计值是一致且无偏的。 类似的，我们可以像无偏性一样证明一致性，为此需要引入概率极限。
计量经济学导论 刘愿

9 简单回归中证明一致性 计量经济学导论 刘愿

10 一个较弱的假定 为了得到无偏性，我们需要零条件均值假设E(u|x1, x2,…,xk) = 0
为了得到一致性，我们仅需要较弱的假定：零均值和零相关:E(u) = 0 ,Cov(xj,u) = 0, for j = 1, 2, …, k. 不满足上述条件，OLS是有偏和不一致的。 计量经济学导论 刘愿

11 Deriving the Inconsistency
Just as we could derive the omitted variable bias earlier, now we want to think about the inconsistency, or asymptotic bias, in this case 计量经济学导论 刘愿

12 Asymptotic Bias (cont)
So, thinking about the direction of the asymptotic bias is just like thinking about the direction of bias for an omitted variable Main difference is that asymptotic bias uses the population variance and covariance, while bias uses the sample counterparts Remember, inconsistency is a large sample problem – it doesn’t go away as add data 计量经济学导论 刘愿

13 Summary of Direction of Asymptotic bias
Corr(x1, x2) > 0 Corr(x1, x2) < 0 b2 > 0 Positive asymptotic bias Negative asymptotic bias b2 < 0 计量经济学导论 刘愿

14 Large Sample Inference
Recall that under the CLM assumptions, the sampling distributions are normal, so we could derive t and F distributions for testing This exact normality was due to assuming the population error distribution was normal This assumption of normal errors implied that the distribution of y, given the x’s, was normal as well 计量经济学导论 刘愿

15 Large Sample Inference (cont)
Easy to come up with examples for which this exact normality assumption will fail Any clearly skewed variable, like wages, arrests, savings, etc. can’t be normal, since a normal distribution is symmetric Normality assumption not needed to conclude OLS is BLUE, only for inference 计量经济学导论 刘愿

16 Central Limit Theorem Based on the central limit theorem, we can show that OLS estimators are asymptotically normal Asymptotic Normality implies that P(Z<z)F(z) as n , or P(Z<z)  F(z) （标准正态累积分布函数） The central limit theorem states that the standardized average of any population with mean m and variance s2 is asymptotically ~N(0,1), or 计量经济学导论 刘愿

17 Theorem 5.2 Asymptotic Normality
计量经济学导论 刘愿

18 计量经济学导论 刘愿

19 Law of large numbers 计量经济学导论 刘愿

20 Asymptotic Normality (cont)
Because the t distribution approaches the normal distribution for large df, we can also say that Note that while we no longer need to assume normality with a large sample, we do still need homoskedasticity 计量经济学导论 刘愿

21 Asymptotic Standard Errors
If u is not normally distributed, we sometimes will refer to the standard error as an asymptotic standard error, since So, we can expect standard errors to shrink at a rate proportional to the inverse of √n 计量经济学导论 刘愿

22 Lagrange Multiplier statistic
Once we are using large samples and relying on asymptotic normality for inference, we can use more that t and F stats The Lagrange multiplier or LM statistic is an alternative for testing multiple exclusion restrictions Because the LM statistic uses an auxiliary regression it’s sometimes called an nR2 stat 计量经济学导论 刘愿

23 LM Statistic (cont) Suppose we have a standard model, y = b0 + b1x1 + b2x bkxk + u and our null hypothesis is H0: bk-q+1 = 0, ... , bk = 0 First, we just run the restricted model 计量经济学导论 刘愿

24 The idea of LM statistic
If the omitted variables xk-q+1 through xk truly have zero population coefficients then, at least approximately, should be uncorrelated with each of these variables in the sample. Running a regression of these residuals on those independent variables excluded under H0, we should get a small enough R2. However, we must include all of the independent variables in the regression for technical reasons. 计量经济学导论 刘愿

25 LM Statistic (cont) With a large sample, the result from an F test and from an LM test should be similar. LM>c, reject H 计量经济学导论 刘愿

26 计量经济学导论 刘愿

27 Example: Economic Model of Crime
Narr86为一个人被拘捕的次数； Pcnv为以前被拘捕后被定罪的次数； Avgsen为过去定罪后被判刑的平均时间长度； Tottime为此人在年龄达到18岁后在1986年以前被送进监狱的总次数； Ptime86为1986年坐牢的月数； Qemp86为此人在1986年合法就业的季度数。 计量经济学导论 刘愿

28 Asymptotic Efficiency
Estimators besides OLS will be consistent However, under the Gauss-Markov assumptions, the OLS estimators will have the smallest asymptotic variances We say that OLS is asymptotically efficient Important to remember our assumptions though, if not homoskedastic, not true 计量经济学导论 刘愿

29 The discussion in the simple regression
g(x) is any function of x, let zi=g(x), then u is uncorrelated with zi. 计量经济学导论 刘愿

30 计量经济学导论 刘愿