Abstracts
Abstract
Inference using large datasets is not nearly as straightforward as conventional econometric theory suggests when the disturbances are clustered, even with very small intra-cluster correlations. The information contained in such a dataset grows much more slowly with the sample size than it would if the observations were independent. Moreover, inferences become increasingly unreliable as the dataset gets larger. These assertions are based on an extensive series of estimations undertaken using a large dataset taken from the U.S. Current Population Survey.
Appendices
Bibliography
- Andrews, D. W. K. (2005). “Cross-section Regression with Common Shocks.” Econometrica, 73(5): 1551-1585.10.1111/j.1468-0262.2005.00629.x Google Scholar Search this bibliographic reference on Google Scholar
- Angrist, J. D., and J.-S. Pischke (2008). Mostly Harmless Econometrics: An Empiricist’s Companion. 1st ed. Princeton University Press.10.2307/j.ctvcm4j72 Google Scholar Search this bibliographic reference on Google Scholar
- Bell, R. M., and D. F. McCaffrey (2002).“Bias reduction in standard errors for linear regression with multi-stage samples.” Survey Methodology, 28(2), 169-181.Google Scholar Search this bibliographic reference on Google Scholar
- Bertrand, M., E. Duflo, and S. Mullainathan (2004). “How much Should we Trust Differences-in-differences Estimates?” The Quarterly Journal of Economics, 119(1): 249-275.10.1162/003355304772839588 Google Scholar Search this bibliographic reference on Google Scholar
- Bester, C. A., T. G. Conley, and C. B. Hansen (2011). “Inference with Dependent data using cluster covariance estimators.” Journal of Econometrics, 165(2): 137-151.10.1016/j.jeconom.2011.01.007 Google Scholar Search this bibliographic reference on Google Scholar
- Binder, D. A. (1983). “On the variances of asymptotically normal estimators from complex surveys.” International Statistical Review, 51(3): 279-292.10.2307/1402588 Google Scholar Search this bibliographic reference on Google Scholar
- Cameron, A. C., J. B. Gelbach, and D. L. Miller (2008). “Bootstrap-based improvements for inference with clustered errors.” The Review of Economics and Statistics, 90(3): 414-427.10.1162/rest.90.3.414 Google Scholar Search this bibliographic reference on Google Scholar
- Card, D., and A. B. Krueger (1994). “Minimum wages and employment: A case study of the fast food industry in New Jersey and Pennsylvania.” American Economic Review, 84(4): 772-793.10.3386/w4509 Google Scholar Search this bibliographic reference on Google Scholar
- Conley, T. G., and C. R. Taber (2011). “Inference with ‘Difference in Differences’ with a small number of policy changes.” The Review of Economics and Statistics, 93(1): 113-125.10.1162/REST_a_00049 Google Scholar Search this bibliographic reference on Google Scholar
- Donald, S. G, and K. Lang (2007). “Inference with difference-in-differences and other panel data.” The Review of Economics and Statistics, 89(2): 221-233.10.1162/rest.89.2.221 Google Scholar Search this bibliographic reference on Google Scholar
- Fuller, W. A. (1975). “Regression analysis for sample Survey.” Sankhya, 37: 117-132Google Scholar Search this bibliographic reference on Google Scholar
- Imbens, G. W., and M. Kolesár (2016). “Robust standard errors in small samples: Some practical advice.” Review of Economics and Statistics, 98(4): 701-712.10.1162/REST_a_00552 Google Scholar Search this bibliographic reference on Google Scholar
- Kloek, T. (1981). “OLS estimation in a model where a microvariable is explained by aggregates and contemporaneous disturbances are equicorrelated.” Econometrica, 49(1): 205-207.10.2307/1911134 Google Scholar Search this bibliographic reference on Google Scholar
- Kolenikov, S. (2010).“Resampling variance estimation for complex survey data.” The Stata Journal, 10: 165-199.10.1177/1536867X1001000201 Google Scholar Search this bibliographic reference on Google Scholar
- Liang, K.-Y., and S. L. Zeger (1986). “Longitudinal data analysis using generalized linear models.” Biometrika, 73(1): 13-22.10.1093/biomet/73.1.13 Google Scholar Search this bibliographic reference on Google Scholar
- MacKinnon, J. G. (2015). “Wild Cluster Bootstrap Confidence Intervals.” L’Actualité économique, 91(1-2): 11-33.
10.7202/1036912ar Google Scholar Search this bibliographic reference on Google Scholar
- MacKinnon, J. G., and H. White (1985). “Some heteroskedasticity Consistent covariance matrix estimators with improved finite sample properties.” Journal of Econometrics, 29(3): 305-325.10.1016/0304-4076(85)90158-7 Google Scholar Search this bibliographic reference on Google Scholar
- MacKinnon, J. G., and M. D. Webb (2016a).“Randomization inference for difference-in-differences with few treated clusters.” Working Paper No. 1355, Queen’s University, Department of Economics.Google Scholar Search this bibliographic reference on Google Scholar
- MacKinnon, J. G., and M. D. Webb (2016b).“The subcluster wild bootstrap for few (treated) clusters.” Working Paper No. 1364, Queen’s University, Department of Economics.Google Scholar Search this bibliographic reference on Google Scholar
- MacKinnon, J. G., and M. D. Webb (2017). “Wild bootstrap inference for wildly different cluster sizes.” Journal of Applied Econometrics, 32(2): 233-254.10.1002/jae.2508 Google Scholar Search this bibliographic reference on Google Scholar
- Moulton, B. R. (1986). “Random group effects and the precision of regression estimates.” Journal of Econometrics, 32(3): 385-397.10.1016/0304-4076(86)90021-7 Google Scholar Search this bibliographic reference on Google Scholar
- Moulton, B. R. (1990). “An illustration of a pitfall in estimating the effects of aggregate variables on micro Units.” Review of Economics and Statistics, 72(2): 334.10.2307/2109724 Google Scholar Search this bibliographic reference on Google Scholar
- Rao, J. N. K., and C. F. J. Wu (1988). “Resampling inference with complex survey data. ” Journal of the American Statistical Association, 83(401): 231-241.10.1080/01621459.1988.10478591 Google Scholar Search this bibliographic reference on Google Scholar
- Webb, M. D. (2014). “Reworking wild bootstrap based inference for clustered errors.” Working Paper No.1315, Queen’s University, Department of Economics.Google Scholar Search this bibliographic reference on Google Scholar
