We document the extent, nature, and consequences of survey errors for receipt of cash welfare and SNAP in three major U.S. household surveys linked to administrative program records. Our results confirm high rates of misreporting of program receipt, particularly failure to report receipt. The surveys inaccurately capture patterns of participation in multiple programs, even though there is little evidence of program confusion. Error rates are higher among imputed observations, which also account for a large share of false positive errors. Many household characteristics have significant effects on errors in reporting receipt, both false positives and false negatives. We find large differences in survey errors by race, ethnicity, income and other household characteristics. We provide evidence on the consequences of these errors for models of program receipt. Estimated effects of income and race are noticeably biased.
We then examine error due to item non-response and imputation, as well as whether imputation improves estimates. Item non-respondents have higher receipt rates than the population, even conditional on many covariates. The assumptions for consistent estimates in multivariate models fail both when excluding item non-respondents and when using the imputed values. In binary choice models of program receipt, estimates from the linked data favor excluding item non-respondents rather than using their imputed values. The biases in each case are well predicted by the error patterns we document, so such analyses can help researchers make more informed decisions on the use of imputed values.
We use cookies to provide you with an optimal website experience. This includes cookies that are necessary for the operation of the site as well as cookies that are only used for anonymous statistical purposes, for comfort settings or to display personalized content. You can decide for yourself which categories you want to allow. Please note that based on your settings, you may not be able to use all of the site's functions.
Cookie settings
These necessary cookies are required to activate the core functionality of the website. An opt-out from these technologies is not available.
In order to further improve our offer and our website, we collect anonymous data for statistics and analyses. With the help of these cookies we can, for example, determine the number of visitors and the effect of certain pages on our website and optimize our content.