- Original article
- Open Access
Reconciling findings on the employment effect of disability insurance
IZA Journal of Labor Policy volume 3, Article number: 11 (2014)
Over the last 25 years, the Social Security Disability Insurance Program (DI) has grown dramatically. During the same period, employment rates for men with work limitations showed substantial declines in both absolute and relative terms. While the timing of these trends suggests that the expansion of DI was a major contributor to employment decline among this group, raising questions about the targeting of disability benefits, studies using denied applicants suggest a more modest role of the DI expansion. To reconcile these findings, we decompose total employment changes into population and employment changes for three categories: DI beneficiaries, denied applicants, and non-applicants. Our results show that during the early 1990s, the growth in DI can fully explain the employment decline for men only under an extreme assumption about the employment potential of beneficiaries. For the period after the mid-1990s, we find little role for the DI program in explaining the continuing employment decline for men with work limitations.
Over the last 25 years, the Social Security Disability Insurance Program (DI) has grown dramatically. In 1985, 2.2 percent of individuals between the ages of 25 and 64 were receiving DI benefits. By 2008, just before the great recession, this fraction had more than doubled to 4.6 percent. A significant share of this increase can be accounted for by the growing work force attachment of women. However, even among men, DI participation grew rapidly over the period, rising from 3.1 to 4.8 percent of 25 to 64 year-old men.
Congressional reforms that made it substantially easier for those suffering from severe pain or depression to obtain benefits, together with increases in the effective after-tax replacement rate, plausibly contributed significantly to both DI participation increases and the downward shift in the age distribution of benefits (Rupp & Stapleton, 1995; Autor & Duggan, 2006) – two phenomena raising concern that many receiving DI benefits may in fact be capable of work. This concern was fueled during the 1990s and 2000s when employment rates for working-aged men remained constant but declined for men with work limitations, as shown in Figure 1. Other researchers have found similar patterns using other sources of data (Burkhauser et al. 2002; Burkhauser et al. 2003)1.
Several influential studies using aggregate data have suggested that the recent growth in DI participation may account for much, if not all of the employment decline of men with work limitations2. At both the national and the state level, Bound and Waidmann (2002) regress the fraction of men out of work with health impairments on the fraction receiving DI, and Autor and Duggan (2003) estimate similar cross-state regressions for the period 1978 to 1998 for high-school drop-outs, who represent a disparate share of those with DI benefits. In both studies, the increase in DI participation appears to have had a major negative effect on employment of men with the highest probability of applying for and receiving DI benefits.
In contrast to these analyses, studies using rejected disability insurance applicants to measure the labor market potential of DI beneficiaries have found that rejected applicants have low earnings and employment rates. Bound (1989) analyzes two samples of denied applicants from the 1970s. Arguing that rejected applicants should be more capable of work than are beneficiaries, he posits that their employment rate can be thought of as an upper bound estimate of how much beneficiaries would work had they not applied for DI. He finds an employment rate for denied male applicants of no more than 50 percent. These results have been replicated for the same age category of men (45 years and older) by von Wachter et al. (2011), who use administrative records spanning the period 1978 to 2004. Chen and van der Klaauw (2008) find similar results using data from the Survey of Income and Program Participation (SIPP) covering the 1990s. They exploit a discontinuity in the determination process to estimate the disincentive effect for a subgroup of applicants whose determination is based on vocational factors3. They estimate that the employment rate of these DI beneficiaries would have been only 20 percent higher had they not received benefits. Finally, Maestas et al. (2013) use administrative data on variation in disability determination examiners’ allowance rates to identify the employment prospects for marginal DI awardees. They find that the employment rate for members of this group would have been 28 percentage points higher had they not received disability benefits. Results from these studies are generally interpreted as evidence that the increased availability and generosity of DI benefits have had, at most, a moderate effect on the employment rates of people with work limitations.
Each of the two approaches for estimating the impact of DI participation on employment involves making assumptions that are open to some question. On the one side, Bound and Waidmann (2002) and Autor and Duggan (2003) observe only ecological correlations. It is possible, though, that men with work limitations found it increasingly difficult to work during the time period and that the DI program drew from a population with relatively low employment rates. If this were the case, the approach used by these two studies would overstate the negative effect of the increase in the availability of DI benefits on the employment of men.
On the other side, Bound (1989), Chen and van der Klaauw (2008), von Wachter et al. (2011), and Maestas et al. (2013) estimate the counterfactual employment rate of beneficiaries assuming the application process itself does not substantially reduce employment for denied applicants. The plausibility of this presumption is open to question (see the interchange between Parsons (1991) and Bound (1991) for a discussion of this issue). The application process effectively requires applicants to remain out of work between their application and the decision on DI benefits. While initial decisions occur within 3 or 4 months, rejected applicants who appeal decisions typically wait several years before a final decision is made, and evidence suggests that these delays lower reemployment prospects (Autor et al. 2011). More important, denied applicants who plan to appeal their rejection or to reapply later are likely to remain out of work for strategic reasons (French and Song, 2012). While the number of denied applicants who appeal was relatively small early in the history of DI, currently about half of those initially denied mount appeals (Autor and Duggan 2010), while others simply reapply. If applying for DI benefits had a negative effect on the employment of denied applicants, using the employment rate of denied applicants could understate the average treatment effect of receiving disability insurance for beneficiaries. In addition, in this case, any growth in the fraction of men who are denied benefits would contribute to overall employment decline.
We overcome the limitations of these two approaches by identifying through administrative records an additional control population – non-applicants with reported work limitations – and by assessing the expansion of the DI system jointly with employment rates for different applicant and age groups. Our results clarify that the employment decline during the early 1990s can be explained by the concurrent DI expansion only under the extreme assumption that the marginal beneficiaries would have worked at rates comparable to non-applicants were they not receiving benefits. In addition, when we extend the analysis past the period of rapid expansion of the DI program into the late 1990s and early 2000s, we find that employment rates for men with work limitations continued to decline, despite a slowdown in the growth rate of DI. This alone suggests important other factors at work.
The next section briefly discusses main features of the DI program and major policy changes over the last several decades. In Section 3, we develop and discuss the decomposition. Section 4 provides a description of the main data sources used for this study. It is followed by results (Section 5) and concluding remarks (Section 6).
The federal government provides cash and medical benefits to the disabled through two programs, the Social Security Disability Insurance (DI) program, which was enacted in 1956, and the Supplemental Security Income (SSI) program, enacted in 1974. For both programs, successful application requires the.
(…) inability to engage in any substantial gainful activity by reason of any medically determinable physical or mental impairment which can be expected to result in death or which has lasted, or can be expected to last, for a continuous period of at least 12 months4.
During the 1960s and 1970s, the DI program was made available to a wider range of people. In 1960, individuals under the age of 50 were made eligible for DI, and in 1965, the definition of disability was liberalized to allow those without permanent disabilities to qualify. In 1972, the waiting period required before an applicant for DI could start receiving benefits was reduced from six to five months and benefit levels were increased. By the mid-1970s, typical after-tax replacement rates reached 60 percent. In addition, the introduction of the Supplemental Security Income program (SSI) effectively eliminated the work history requirement for those without either significant assets or other sources of income. With the increase in both the availability and generosity of the program, it is no surprise that DI rolls grew rapidly during the 1960s and 1970s, reaching 2.9 million (3 percent of the working-age population) by 1980. Total benefits paid out exceeded $15 billion, or 20 percent of benefits paid out for retirement. During the 1970s, concern grew that the Social Security Administration (SSA) was losing control over the system and that many DI beneficiaries might not actually be eligible under the law. The SSA responded both by refining the regulations guiding decisions, and by negotiating agreements with various states. The consequences were quite dramatic. Award rates fell from 48.8 to 33.3 percent between 1975 and 1980, with this decline concentrated among states that had been more lenient in their decision making.
In 1980, Congress passed legislation designed to further tighten administrative control over the disability determination process by changing both the frequency and the nature of medical eligibility reviews for disability beneficiaries. This legislation had a discernible impact on administrative practice, with the number of new awards dropping from 40 to 29 percent of all insured workers between 1980 and 1982, and the number of benefit terminations increasing five-fold. In two years’ time, 25 percent of beneficiaries had their cases reviewed and more than 40 percent of those reviewed had their benefits terminated. These stricter practices led to questions about due process. Many who had their benefits terminated during this period won reinstatement on appeal, and concern grew that many of those who did not appeal their terminations were, in fact, eligible for benefits.
Widespread criticism led Congress to reverse course in 1984 with amendments that had a profound effect on the standards used to evaluate DI eligibility. First, the burden of proof was shifted onto the Social Security Administration to demonstrate that the health of beneficiaries under review had improved sufficiently to allow them to return to work. Second, a moratorium was imposed on reevaluations of the most troublesome cases –those involving mental impairments or pain –until more appropriate guidelines could be developed. Third, benefits were continued for those whose terminations were under appeal. Fourth, more weight was given to source evidence (evidence provided by the claimant's own physician) by requiring that it be considered first, prior to the results of an SSA consultative examination. Fifth, consideration had to be given to the combined effect of all of an individual's impairments, regardless of whether any single impairment was severe enough to qualify the individual for benefits. Finally, and perhaps most important, the SSA substantially revised its treatment of mental illness, reducing the weight given to diagnostic or medical factors and emphasizing the ability of an individual to function in work or work-like settings.
Eligibility criteria were further liberalized in 1988 and then again in 1991 when the SSA issued new rulings on pain that gave controlling weight to source evidence when such opinions were supported by medical evidence and were not inconsistent with other evidence in the case record. In addition, court opinions throughout the 1980s and early 1990s tended to reinforce SSA’s shift in favor of source opinions (Social Security Advisory Board 2001).
Figure 2 displays DI participation by age groups, expressed as percentages of all adult men in each group, for the period 1970 to 2012. The figure clearly shows both the drop in participation during the late 1970s and early 1980s and the strong increase in participation since the early 1990s, the latter of which was concentrated among men 45 years or older and especially among men 55 or older.
3 Empirical methodology
We decompose the overall change in employment rates for men reporting a work limitation into changes within and between application categories. Consider the following decomposition of the employment rate of men with some health impairment at a time t = 1:
where the b, d, and n subscripts index beneficiaries, denied applicants, and non-applicants, respectively, and E's represent first the overall employment rate of those with work limitations, and then the employment rates of those on DI, those who applied for DI benefits but were rejected, and those with limitations who never applied for benefits. In this decomposition we ignore men who are currently applying for DI and former beneficiaries whose benefits were terminated. Both groups are small and do not change the empirical results. The W's represent the fractions of the population in each group that identify as having work limitations. The employment rate for t = 2 can be decomposed in the same fashion:
Taking the difference between the two time periods and denoting changes by △ yields:
where upper bars indicate averages taken over two periods. We can rewrite equation (1) using the fact that ΔW n = -(ΔW b + ΔW d ).
Equation (2) is simply an accounting identity. However, if we assume that newly induced DI applicants would have had employment rates similar to those of non-applicants had they not applied for DI, then the first two terms have an economic interpretation. The first term in the decomposition measures the effect that the growth in the fraction of DI beneficiaries has on the employment decline of those with work limitations, while the second term measures the effect that the growth in the fraction of denied applicants has on the employment decline. The last three terms represent within-group employment declines, which presumably reflect factors affecting the employment of the disabled that are unrelated to program growth. The extent to which any of these components are related to the increased availability of DI benefits is not clear, and for the last component, which reflects employment changes among those who never applied for DI benefits, it seems safe to assume that this component does not reflect any behavioral effect of the program5.
If the increased availability of DI benefits during the 1990s has mainly affected men who previously would have been working at rates comparable to non-applicants, then equation (2) accurately measures the employment effect of the disability insurance program during this time. It seems more plausible, however, that this form of decomposition overstates the role of the DI growth, since it assumes that denied applicants and beneficiaries would have the same employment rate as non-applicants if they had not applied.
An alternative decomposition involves substituting out ΔW d instead of ΔW n in equation (1). We obtain then:
In this case, the expansion of the DI program is weighted by the difference instead of . The leading term of this decomposition reflects the effect of the expansion of DI on employment under two premises: (1) if marginal beneficiaries would have had employment rates similar to denied applicants, had they not been receiving benefits, and (2) if the application for DI itself did not reduce the employment of denied applicants.
These two decompositions help us interpret previous studies on the employment effect of DI. The approach used by Bound and Waidmann (2002) and by Autor and Duggan (2003) may be stated as estimating a type of the following specification:
If there is no correlation between ΔW b and other factors that affect the employment decline of men with work limitations then the OLS estimate consistently estimates the employment effect of DI expansion. However, if factors other than the increased availability of DI benefits contributed to the employment decline, as seems plausible, then ϵ and W b in equation (4) will be negatively correlated, and the magnitude of will be biased upwards. Autor and Duggan (2003) address this issue by using instrumental variables. They exploit changes in DI generosity due to shifts in the wage distribution. An obvious issue is that their instrumental variable (IV) estimates are very imprecise (the 95 percent confidence interval for men after 1984 includes the possibility that the growth of DI had no effect on employment decline).
In contrast, studies that base inference on the behavior of denied applicants, such as those by Bound (1989) and von Wachter et al. (2011) interpret the first term of (3) as an upper-bound estimate of the effect of DI expansion on employment. This use of denied applicants as a control group presupposes that the act of applying for DI benefits has no effect on employment. The regression discontinuity (RD) approach used by Chen and van der Klaauw (2008) and the IV approach used by Maestas et al. (2013) manage to identify marginal beneficiaries. However, in both cases, the estimates identify the effect of being awarded benefits on employment, which is conditional on having applied for benefits. Thus, if applying per se has an effect on employment, these RD and IV approaches will not identify the full affect of DI on employment.
4 Data and sample selection
Estimating the decompositions requires information about fractions of non-applicants, denied applicants, and beneficiaries, as well as their respective employment rates. We use data from the Census Bureau’s Survey of Income and Program Participation (SIPP), a nationally representative sample of individuals 15 years of age and older in the civilian non-institutionalized population. Initiated in 1983, the SIPP interviews panels of respondents once every four months for two to four years. When sampling a new SIPP panel, the Census Bureau randomly assigns respondents into one of four rotation groups, with each group interviewed one month after the previous one. When interviewed, respondents are asked to provide information about the preceding four months, also called reference months.
While the SIPP asks respondents about their employment situation and work limitations, it does not contain information regarding applications to and outcomes for DI. We used several administrative files to identify DI beneficiaries, denied applicants, and non-applicants, and matched them to SIPP records using respondents’ Social Security numbers (SSN). Since people who disclose their SSN systematically differ from people who do not, we reweight the original population weights provided by Census (Raghunathan, 2004) before selecting those respondents who disclosed their SSN. We also match SIPP files to Master Earnings Records (MER) that contain yearly earnings records based on W-2 forms.
We restricted our sample to men ages 25 to 61 with a reported a work limitation, as indicated by a positive response to this question in the SIPP:
“Does [insert name] have a physical, mental, or other health condition which limits the kind or amount of work [insert name] can do”?
We use this measure to limit our sample because men who report no such limitation are very unlikely to either apply for DI benefits or have them awarded. Although this question asks about physical and mental health conditions, some studies suggest that such general disability measures do not fully capture all people with mental health conditions. Therefore, we likely select a population with more physical than mental health conditions6.
We eliminate men younger than 25 because very few such individuals apply for DI, and we eliminate those older than 61 because these individuals are eligible for Social Security Retirement benefits. We also exclude men who have served in the armed forces, and men who have applied or are currently applying for SSI but not for DI7. With these restrictions, the fraction of men identified as having a work limitation remains approximately constant through the years we examine (see Table 1). For an exact decomposition, we also disregard current applicants and men whose DI benefits had been terminated. Both groups are relatively small, and a more extensive decomposition that includes these two groups does not change the results8.
The administrative records (SSN and MER) are not available for SIPP panels 1986 to 1989. Therefore, we restrict our analysis to later SIPP panels. Maag and Wittenburg (2003) identified several problems with SIPP panels prior to 1996. Of interest here is that interviewer prompting likely led to over-reporting of work limitations for all waves except the first one. Therefore, we use only the first-wave data for pre-1996 panels. For the 1996 and 2001 panels, we disregard the first waves due to apparent problems following questionnaire redesign9. Finally, we select the fourth reference month for each wave10, and use the last weeks' employment status, which corresponds to the standard CPS employment measure. Details on administrative records and the sample selection are contained in Appendix A.
We use three SIPP panel waves for our decomposition by age and applicant status: 1990, wave 1; 1996, wave 2; and 2004, wave 1. The fourth reference month of 1990, wave 1 covers January through April 1990, just before the recession of 1990/1991 and the expansion of the DI program started11. The fourth reference month of 1996, wave 2 covers July through October 1996, a time when the major expansion of the early 1990s had subsided. To examine the second expansion during the late 1990s and early 2000s, we use the 2004, wave 1 SIPP data, which cover January through April 200412. In addition, we use all waves for these panels to discuss some of the findings of the decomposition.
Table 2 presents population fractions of men in the three analyzed panel-waves by age category and DI applicant status (non-applicant, beneficiary, and denied applicant). At the beginning of 1990, slightly more than two thirds of men 25 to 61 years old with a reported work limitation were non-applicants, 19 percent were beneficiaries, and 13.9 percent were denied applicants. Older men were more likely to receive DI benefits, whereas the fraction of the population denied benefits was similar across age groups. By 1996, the picture had changed quite dramatically. The fraction of non-applicants had decreased by 10 percentage points to 56.9 percent, matched by a corresponding increase of 10 percentage points, to 29.2 percent, in the fraction of beneficiaries. The fraction of denied applicants remained stable 1990-1996 at around 14 percent13. The increase in beneficiaries was concentrated among men 25 to 44 years old, with the percentage of beneficiaries 44 years or younger almost doubling from 1990 to 1996. However, in absolute terms, the increase was highest for men 55 years and older, with DI participation in this age category increasing from 29.7 percent to 42.6 percent. Comparing the 1996 panel to the 2004 panel, we observe a further decline in the fraction of non-applicants to 51.8 percent, a 3.4 percentage point increase in the fraction of beneficiaries, and a 1.8 percentage point increase in the fraction of denied applicants.
Table 3 shows corresponding employment rates. In 1990, the employment rate was 61.1 percent for non-applicants, 34.1 percent for denied applicants, and 5.7 percent for beneficiaries14. Men age 25 to 44 years in 1990 had a similar total employment rate as men 45 to 54, but employment rates for non-applicants and denied applicants were much lower for the younger than for the older group. The contrast for these two age groups lies in the employment rate of beneficiaries, which is 14 percent for 25 to 44 year old men, but less than 3 percent for those 45 to 54 years. For the most part, this age pattern for non-applicants and beneficiaries remains remarkably stable across panel years, indicating that the difference in the employment rate of non-applicants versus beneficiaries is not necessarily larger for younger than for older men15.
Table 4 displays characteristics of beneficiaries, denied applicants, and non-applicants for each of the three panel-waves used in our analysis. The quantities we report are age-adjusted to the age distribution of beneficiaries (see Appendix B for details). Table 4 includes the fraction of respondents who identify themselves in fair or poor health, together with the average number of reported functional limitations and problems with Activities of Daily Living (ADL). It also presents MER earnings information covering 10 years up to the interview year in the form of the percent with positive earnings in at least 5 of these 10 years, and the average number of these 10 years with annual earnings above $1,000 dollars (expressed in year 2000 values). We do not include past employment and earnings measures for DI beneficiaries because these are not meaningful.
Non-applicants tend to be better educated, more likely to be white, and less likely to be black than either the denied applicants or beneficiaries. Fewer of the non-applicants report being in poor or fair health and they cite fewer functional limitations or ADL problems than do the other two groups. Denied applicants are on average in better health than are beneficiaries. On average, non-applicants worked for between seven and eight of the last 10 years and were very likely to have had positive earnings for at least half of those 10 years. Overall, even amongst those with some kind of work limitation, non-applicants appear to be in better health and more capable of work than those who applied, but were denied benefits. Across cohorts, educational attainment appears to be rising for all three groups. We suspect that this trend simply reflects secular trends in educational attainment in the U.S. working-age population.
Table 5 shows results for the first decomposition approach, shown in equation (2), and the second decomposition approach, shown in equation (3). For the 1990-1996 comparison, the first decomposition suggests an estimated employment decline attributable to the increased availability of DI benefits that exceeds the overall employment decline (ΔE) if all men 25 to 61 years of age are considered. Separate decompositions by age groups reveal that employment rates declined during that period only for men who were 25 to 54 years old, and that DI growth can explain this entire decline. However, the contribution of the DI expansion looks quite different using the second decomposition (Equation 3), which suggests that the growth in DI can explain only about half of the overall employment decline for 25-54 year-old men.
Decompositions for the 1996-2004 comparison show a much larger overall employment decline – exceeding 10 percentage points for men 25 to 44 years old. No matter which decomposition is used, these dramatic employment changes were not nearly matched by a corresponding expansion of the DI program. For the 1996-2004 period, the DI program can explain 30 to 50 percent of the overall employment decline. Even more startling are the decompositions for the three different age groups. Especially for men 25 to 44 years old, the portion of the employment decline attributable to the expansion of the DI program is at most 20 percent. Appendix C contains further sensitivity analyses for the SIPP data that support this finding.
This study has attempted to reconcile divergent findings concerning the employment effect of the DI program. Using a decomposition strategy, we find that it is unlikely that the growth in the fraction of DI beneficiaries during the early 1990s can fully explain the employment decline during this period. This result is substantiated by the steady employment declines during the mid-1990s to mid-2000s that were unaccompanied by similar increases in the fraction of DI beneficiaries. It therefore seems likely that factors other than the DI program itself have contributed to employment decline from 1990 to 2004. This is precisely the context in which the methods used by Bound and Waidmann (2002) and Autor and Duggan (2003) are likely to exaggerate the causal role played by DI in explaining the decline in the employment of men with work limitations. This is not to say that the increased availability and generosity of disability benefits did not contribute at all to the decline in the employment of men with a work limitation. As long as some fraction of DI beneficiaries would have continued to work had such benefits not been available to them, the growth in the availability/generosity of benefits will have contributed to the drop in the employment of men with work limitations. However, our tabulations suggest other factors were at work as well in explaining the employment decline.
If the DI expansion does not explain the bulk of the drop in employment among men with work limitations, we are still left with the question of what does explain that trend. While answering this question is beyond the scope of this paper, we can shed some light on directions for future research. For example, SIPP and CPS data can be used to examine sources of household income for men with work limitations who are neither working nor receiving disability benefits. For the families of these men, the earnings of other household members represent an important source of income as do benefits from various social insurance programs, such as veterans and workers compensation benefits (Stewart, 2006). SIPP and CPS data provide no evidence that these other social insurance programs have become more available or more generous over the period in question –if anything, they show the reverse to be true. Beyond this, the fraction of men with limitations who are married and living with their spouse has fallen between 1990 and 2004, making it harder for these men to rely on spousal earnings. Broadly, therefore, we see no evidence that men with work limitations left the workforce during this period because of an increase in the availability of alternative sources of income. However, there is substantial evidence that there has been a secular decline in the demand of those with no more than a high school education in the U.S. economy (Autor et al. 2008; Elsby & Shapiro, 2012). It seems plausible that these trends would have made it particularly difficult for men with substantial health limitations to find gainful employment. Future research will be needed to understand better how such demand changes have affected people with disabilities.
1Correspondingly, while employment rates for women increased during the same time, employment rates for women with a work limitation remained constant.
2For a thorough discussion of alternative possible explanations for the decline in the employment rates of those with reported work limitations see Burkhauser & Stapleton (2003a). The various authors in this volume consider various alternative explanations, including changes in demographic composition of the working age population with disabilities, changes in the nature of work, changes in the severity of disabilities, and the the unintended consequences of the Americans with Disabilities Act. In the final chapter to this edited volume, Burkhauser and Stapleton conclude that, while various factors may have contributed to the decline in the employment rates of men identified with work limitations, increases in the availability and generosity of federal disability benefits probably played the largest role (Burkhauser & Stapleton, 2003b).
3Initial applications for disability insurance follow a five-stage procedure. Vocational factors are considered at the fifth stage for those applicants who have not qualified for disability insurance based on severe impairments. See Hu, et al. (2001) for a description of the application process.
4See Title II of the Social Security Act, Section 223. [42U.S.C. 423], (d) (1) (A) (http://www.socialsecurity.gov/OP_Home/ssact/title02/0223.htm).
5With the expansion of DI, the size of the population of non-applicants will shrink. Presumably this should mean the remaining non-applicants are more capable of doing work. Thus, these compositional shifts should work in the direction of making this last term positive. To the extent that this term is negative, it would seem to clearly point to factors unrelated to the increased availability of DI contributing to the decline in the employment of the men with work limitations.
6For instance, a study based on the National Comorbidity Survey suggests that general disability measures used in surveys such as the SIPP or the Current Population Survey undercount people with mental health conditions (Kessler et al. 2005).
7People can apply for DI and SSI for the blind and disabled simultaneously if they fulfill the respective eligibility criteria. These dual applicant or beneficiaries are not disregarded.
8For the sample prior to disregarding current applicants and men who had received disability insurance, the fraction of current applicants is generally between 2.5 and 5.5 percent for the waves considered, and does not show any trend. The fraction of men those benefits have been terminated increases from about 1 percent to 3 percent between the 1990 and 2004 panel, which is consistent with a decrease of terminations due to death and retirement, and an increase of terminations due to medical disqualifications since the late 1980s (Autor & Duggan, 2006).
9See Appendix A for a discussion of these problems.
10This is the month preceding the interview month and therefore likely to be the least affected by recall bias regarding past employment status.
11Following the NBER business cycle dates, the recession of 1990/1991 started in July 1990.
12Results from the 2004 SIPP should be treated with caution, since the percentage of men with work limitation is noticeably higher as compared to previous panels. If the population with a work limitation in the 2004 panel is more healthy as compared to the population with a work limitation in previous panels, then both the overall employment change and the role of DI growth would be understated. The overall bias for the decomposition is therefore unclear.
13It appears that an increase in the application success probability since the mid-1980s has mainly contributed to a stable fraction of denied applicants.
14As mentioned in Section 2, beneficiaries are not prohibited from working fully, but may work to some extent, as long as their earnings do not exceed a certain threshold, called the “Substantial Gainful Activity” amount.
15For instance, in 1990, the difference is 46.5 percent for men 25-44 years old, but 66.9 percent for men 44-54 years old and 51.1 percent 55-61 years old.
16If denied benefits at the initial determination process, applicants can ask for reconsideration. If still denied benefits, they can further appeal the decision to an Administrative Law Judge and an Appeal Board. See Benitez-Silva, et al. (1999) for a detailed analysis of the appeal process.
17In practice, dates of filing might differ for same applications in these files. Therefore, we matched records which were filed within 50 days. PHUS records are matched to 831 or MBR records if the benefit begin date is within 100 days of the date an application decision has been reached.
18Specifically, they are asked: “We have recorded that [person]'s health limits the kind or amount of work [person] can do. Is that correct”?
19For these tabulations, we select men as described in Section 4, except selection based on their SSN. Therefore, Table 6 presents accurate percentages for the sample used for the decomposition prior to selection based on SSN disclosure.
20Leaving men who do not disclose their SSN in the sample is not an option since they would be classified as non-applicants, even though some of them are beneficiaries or denied applicants.
21We use the following age categories: 25-29 years, 30-34 years, 35-39 years, 40-44 years, 45-49 years, 50-54 years, and 55-61 years.
22In order to verify our supposition regarding the bias due to SSN disclosure, we compared population fractions, employment rates, and decompositions using the original person-month weights and the corrected person-month weights. The correction does increase the fraction of DI recipients and denied applicants, as well as decrease the employment rates for all applicant groups. Furthermore, these changes tend to be more severe for panels with a lower disclosure percentage. For the decomposition, we find that using the corrected weights slightly reduces the role of the expansion of the DI program in explaining the observed employment declines.
A. Data selection, administrative records, and reweighting
Administrative records: Applications are identified through so-called 831 files. When a person applies for DI, an 831 file is opened. It subsequently documents all application stages up to the reconsideration stage16. We use 831 files from 1978 onwards, which is the earliest year they are currently available. This restriction is likely to understate the number of denied applicants slightly, especially for the earlier years of the analysis.
While 831 records provide accurate information on application dates and outcomes of initial application and reconsideration, they do not record appeal decisions. However, an increasing fraction of initially denied applications have been appealed. For instance, in 2002, about one-third of all applications were decided through the appeal process. Of these, more than three quarters were successful, as opposed to only 37 percent successful initial applications (Szymendera, 2006). These successful appeals would be misclassified as denial by 831 records.
In order to improve on the accuracy of the application information of the 831 files, we augment them with the Master Beneficiary Records (MBR). The MBR contain complete application information including appeals, but only for the latest disability application. MBR records are matched to 831 files using dates of application. Furthermore, we use the Payment History Update System (PHUS) to identify successful appeals which have been erased from the MBR. The PHUS records monthly information on benefits received from 1984 onwards. They are matched to 831 files and MBR records using benefit begin dates17. Aside from these administrative records, we also match SIPP respondents to Master Earnings Records (DER). These are yearly earnings records based on W-2 forms.
Work limitation: The SIPP contains a standard work limitation question: “Does [person] have a physical, mental, or other health condition which limits the kind or amount of work [person] can do”? Before the 1996 panel, people were asked this question during the first wave, and then only for some subsequent waves which contained health and disability modules. In these modules, people who had indicated a work limitation in a previous wave were reminded of his or her affirmative response before the question was asked again18. With the 1996 redesign, the work limitation question was included in all core surveys, and people were not reminded of their previous response. Maag and Wittenburg (2003) show that before the 1996 redesign, the prevalence rate of work limitation increased within each panel over subsequent waves, whereas such a trend is not visible for the 1996 panel. They hypothesize that those who indicated having a work limitation in a previous wave are more likely to respond positively to the question if they were reminded about their earlier response. Figure 3 replicates their findings using SIPP panels 1984 to 2004 for men age 25 to 61. As can be seen, the prevalence rates generally increase within each wave before the 1996 redesign. In contrast, the 1996, 2001, and 2004 SIPP panels do not exhibit such a trend.
As a consequence of this reporting bias, it is plausible that people with work limitations are relatively more healthy for later waves than for earlier ones. Consequently, employment rates of people with work limitation are likely to be upward biased for later waves of these panels. Figure 4 demonstrates the effect of the recall bias on employment rates. As the fraction of men indicating a work limitation increases for SIPP panels 1984-1993, so does their employment rate. In contrast, employment rates remain stable across waves for later panels.
In order to circumvent the recall bias with respect to the work limitation question on estimates of employment changes, we restrict our analysis to the first wave prior to the 1996 redesign. Figure 5 shows trends in the prevalence rates of men with work limitations, using wave one, two, and four of SIPP panels between 1984 and 2004. It illustrates that the prevalence rate remains fairly stable between 1984 and 2004 when only same waves are considered. Figure 6 depicts corresponding employment trends for men with work limitations. The decline in the employment rate is similar to the CPS based trend of Figure 1, although it seems to have started earlier.
We also disregard the first wave of the 1996 panel, since numerous changes implemented in the 1996 SIPP redesign are likely to have affected data reporting for the first wave (Maag & Wittenburg, 2003). As shown in Figure 3, the work limitation prevalence rate is somewhat higher for the first wave of the 1996 SIPP panel than in subsequent waves. This anomaly also appears for the 2001 SIPP panel. We suspect that similar implementation issues affected that wave, and disregard it as well. Concerning the 2004 SIPP panel, we consider the first seven waves only, because administrative records were only available until the end of 2005 when we conducted our study.
SSN disclosure: Table 6 reports the percentage of men, 25 to 61 years old, who did and who did not disclose their SSN for selected waves of panels 1984 to 200419. The percentage of men who disclose their SSN declines from 92% for the SIPP 1990 to 85% for the SIPP 1996, and further to 76% for the SIPP 2004, wave 1. Moreover, the percentage is only 62% for the SIPP 2001, wave 1, and declines to just above 60% for subsequent waves of that panel. For that panel, the low percentage of disclosures was apparently caused by Census' asking about respondents' SSN through telephone interviews.
The decreasing SSN disclosure percentage poses two problems. First, since those who do not report their SSN are subsequently disregarded, a lower disclosure percentage reduces the final sample size20. Second, and more seriously, if men who disclose their SSN systematically differ from men who do not, than selection based on SSN disclosure can bias the results from the decomposition. Table 7 shows demographic and economic characteristics for selected waves of those who disclosed and those who did not disclose their SSN, respectively. Men who disclosed their SSN are more likely to be better educated, married and employed than those who did not disclose their SSN. They also tend to be more likely to report a work limitation in the 1990 SIPP panel, but they are less likely to do so for the 2001 and 2004 panel. For a given panel, these differences in observable characteristics suggest that we would overstate the employment rate among all application groups, and understate the fractions of beneficiaries and denied applicants, since these population groups are less likely to be higher educated, married, and employed. Moreover, since the percentage of men who disclose their SSN decreases over subsequent panels, we would expect these biases to become more severe for later panels. Consequently, we would obtain estimates for the increase in DI enrollment and for the decline in employment rates which are too low. In order to correct for these biases, we reweight the original population weights provided by Census to account for non-random selection by SSN disclosure status (see for instance Ragunathan, 2004). For that, we estimate weighted logit models of SSN disclosure for each panel separately. We use the person-month weights provided by Census and include the same variables as in Table 7, except for flexible age dummies21. We then divide the original weights by the predicted values in order to obtain corrected weights. This procedure eliminates the biases which result from selection on SSN if this selection, conditional on the observable characteristics, is random22.
B. Variables and calculations for demographic characteristics
Table 4 displays age-adjusted averages and percentage values, where we adjust for age using the age distribution of beneficiaries. To this end, we first construct for weights reflecting the fraction of beneficiaries in the following age groups: 25-34 years, 35-44 years, 45-54 years, and 55 to 61 years. We use corrected individual weights to calculate these fractions (see Appendix A for details). In a second step, we use these weights to calculate weighted averages or percentages for each applicant category (non-applicants, denied applicants, and beneficiaries). We construct such weights separately for each panel.
We use three variables from SIPP’s core survey: age, education, and race. We also use several topical modules to include information about health and earnings. To calculate the number of functional limitations and problems with Activities of Daily Living, we use topical modules closest to the waves of our analysis. These are the third topical module for the 1990 SIPP and the fifth topical module for the 1996 and 2004 SIPP. We also use a general health question from these topical modules (“Would you say the person’s health in general is excellent, very good, good, fair or poor?”) to construct a binary variable equals to one if the respondent’s health is fair or poor.
Aside from health-related variables, we use summary earnings from the Master Earnings Records (MER) covering the interview year and the nine years before the interview year. We use these 10 years of earnings to construct two variables. The first one is the average number of these 10 years a respondent had earnings exceeding $1,000. The second one is an approximation of whether the respondent is disability insured, which is a binary variable equals to one if the respondent had positive earnings during at least 5 of the last 10 years.
C. Further sensitivity analysis for the SIPP
In order to substantiate our finding that the DI program can explain little of the employment decline in the SIPP since the mid-1990s, we combine each 1996 wave (except for the first) with each 2004 wave and carry out the first decomposition. We then aggregate results into two sources of employment changes: the employment effect due to changes in DI beneficiaries and denied applicants (the first two terms in Equation 2), and changes in employment rates of non-applicants, beneficiaries, and denied applicants (the last three terms of Equation 2). This procedure yields 77 decompositions for the 1996-2004 comparison. For 66 out of 77 cases both the employment effect due to changes in DI beneficiaries and denied applicants and changes in employment rates of all applicant groups are negative. In eleven cases, the employment change is positive while the DI growth term is negative. As argued earlier, the results for the 2004 panel are likely to be confounded by much stronger changes in the percentage of men indicating a work limitation (see footnote 12). For those cases for which both differences are negative, the total employment effect never explains more than 50 percent of the overall employment decline.
Autor DH, Duggan MG: The rise in the disability rolls and the decline in unemployment. Q J Econ 2003,118(1):157–205. 10.1162/00335530360535171
Autor DH, Duggan MG: The growth in the social security disability rolls: a fiscal crisis unfolding. J Econ Perspect 2006, 20: 71–96. 10.1257/jep.20.3.71
Autor DH, Duggan MG: Supporting work: a proposal for modernizing the U.S. disability insurance system. Center for American Progress and the Hamilton Project, Washington, DC, USA; 2010.
Autor DH, Katz LF, Kearney MS: Trends in U.S. wage inequality: revising the revisionists. Rev Econ Stat 2008,90(2):300–323. 10.1162/rest.90.2.300
Autor D, Maestas N, Mullen K, Strand A: Does Delay Cause Decay? The Effet of Administrative Decision Time on the Labor Force Participation and Earnings of Disability Applicants. Michigan Retirement Research Center Working Paper No, Ann Arbor; 2011:2011–2258.
Benitez-Silva H, Buchinsky M, Chan HM, Sheidvasser S: An empirical analysis of the social security disability application, appeal, and award process. Labour Econ 1999,6(2):147–148. 10.1016/S0927-5371(99)00014-7
Bound J: The health and earnings of rejected disability insurance applicants. Am Econ Rev 1989,79(3):482–503.
Bound J: The health and earnings of rejected disability insurance applicants: reply. Am Econ Rev 1991,81(5):1427–1434.
Bound J, Waidmann T: Accounting for recent declines in employment rates among working-aged men and women with disabilities. J Hum Resour 2002,37(2):231–250. 10.2307/3069646
Burkhauser RV, Stapleton DC: The Decline in Employment of People with Disabilities: A Policy Puzzle. W.E. Upjohn Institute for Employment Research, Kalamazoo, MI; 2003a.
Burkhauser RV, Stapleton DC: A Review of Evidence and its Implications for Policy Change. In The Decline in Employment of People with Disabilities: A Policy Puzzle. Edited by: Burkhauser RV, Stapleton DC. W.E. Upjohn Institute for Employment Research, Kalamazoo, MI; 2003b:369–406.
Burkhauser RV, Daly MC, Houtenville A, Nargis N: Self-reported work-limitation data: what they can and cannot tell us. Demography 2002,39(3):541–555. 10.1353/dem.2002.0025
Burkhauser RV, Houtenville AJ, Wittenburg DC: A User's Guide to Current Statistics on the Employment of People with Disabilities. In The Decline in Employment of People with Disabilities: A Policy Puzzle. Edited by: Stapleton RV. W.E. Upjohn Institute for Employment Research, Kalamazoo, MI; 2003:23–74.
Chen S, van der Klaauw W: The work disincentive effects of the disability insurance program in the 1990s. J Econ 2008, 142: 757–784. 10.1016/j.jeconom.2007.05.016
Elsby MW, Shapiro MD: Why does trend growth affect equilibrium employment? A new explanation of an old puzzle. Am Econ Rev 2012,102(4):1378–1413. 10.1257/aer.102.4.1378
French E, Song J: The effect of disability insurance receipt on labor supply: a dynamic analysis. Federal Reserve Bank of Chicago Working Paper No. 2012–12, Chicago, Illinois, USA; 2012.
Hu J, Lahiri K, Vaughan DR, Wixon B: A structural model of social security's disability determination process. Rev Econ Stat 2001,83(2):348–361. 10.1162/00346530151143879
Kessler RC, Tat CW, Demler O, Walters EE: Prevalence, severity, and comorbidity of twelve-month DSM-IV disorders in the national comorbidity survey replication (NCS-R). Arch Gen Psychiatry 2005,62(6):617–627. 10.1001/archpsyc.62.6.617
Maag EM, Wittenburg D: Real Trends or Measurement Problems? Disability and Employment Trends from the Survey of Income and Program. Participation, Urban Institute; 2003.
Maestas N, Mullen K, Strand A: Does disability insurance receipt discourage work? Using examiner assignment to estimate causal effects of SSDI receipt. Am Econ Rev 2013,103(5):1797–1829. 10.1257/aer.103.5.1797
Parsons D: The health and earnings of rejected disability insurance applicants: comment. Am Econ Rev 1991,81(5):1419–1426.
Raghunathan TE: What do we do with missing data? Some options for analysis of incomplete data. Annu Rev Public Health 2004,25(1):99–117. 10.1146/annurev.publhealth.25.102802.124410
Rupp K, Stapleton D: Determinants of the growth in the social security administration's disability programs – an overview. Soc Secur Bull 1995,58(4):43–70.
Social Security Advisory Board: Charting the future of Social Security’s disability programs: the need for fundamental change. Washington, DC, USA; 2001.
Stewart J: Male nonworkers: who are they and who supports them? Demography 2006,43(3):537–552. 10.1353/dem.2006.0028
Szymendera S: Social Security Disability Insurance (SSDI) and Supplemental Security Income (SSI): Proposed Changes to the Disability Determination and Appeals Processes. Congressional Research Service, Washington, DC, USA; 2006.
von Wachter T, Song J, Manchester J: Trends in employment and earnings of allowed and rejected applicants to the social security disability insurance program. Am Econ Rev 2011,101(7):3308–3329. 10.1257/aer.101.7.3308
This work has been supported by a grant from the Social Security Administration through the Michigan Retirement Research Center. The findings and conclusions expressed are solely those of the author and do not represent the views of the Social Security Administration, any agency of the Federal government, or the Michigan Retirement Research Center. We would like to thank David Wittenburg, an anonymous reviewer and seminar participants from the University of Michigan, the 2011 Retirement Research Consortium Annual Meeting, and Columbia University for their helpful suggestions. We are grateful to Paul Davies, Lynn Fisher and Thuy Ho for their support in accessing the administrative records and to N.E. Barr for editorial assistance.
This paper was submitted to the IZA Journal of Labor Policy's call for papers on "Social Security Disability Benefits: Finding Alternatives to Benefit Receipt. "Two special editors, David Wittenburg and Gina Livermore, were sponsored by the University of New Hampshire’s Rehabilitation, Research, and Training Center on Employment Policy and Measurement, funded by the U.S. Department of Education (ED), National Institute on Disability and Rehabilitation Research (cooperative agreement no. H133B100030). Their comments do not necessarily represent the policies of ED or any other federal agency (Edgar, 75.620 (b)). The authors are solely responsible for all views expressed.
Responsible editor: David Wittenburg
The IZA Journal of Labor Policy is committed to the IZA Guiding Principles of Research Integrity. The authors declare that they have observed these principles.
Authors’ original submitted files for images
Below are the links to the authors’ original submitted files for images.
About this article
Cite this article
Bound, J., Lindner, S. & Waidmann, T. Reconciling findings on the employment effect of disability insurance. IZA J Labor Policy 3, 11 (2014). https://doi.org/10.1186/2193-9004-3-11
- Social security disability insurance program
- Employment trends