http://www.researchforum.org/project_general_5.html

Vermont Welfare Restructuring Project Evaluation

General Information

View a brief abstract of this project.

View a complete, printer-friendly profile of this project.

Evaluator(s) MDRC
Investigator(s) Dan Bloom (MDRC)
Barbara Goldman (MDRC)
Sponsor(s) Vermont Department of Social Welfare
Funder(s) US Department of Health and Human Services, Administration for Children and Families
Ford Foundation
Vermont Department of Social Welfare
US Department of Health and Human Services
Subcontractor(s) Not applicable
 
Domain Income Security/TANF
Status Completed (final report released)
Duration Jul 1994 - Mar 2002
Type Research and/or Program Evaluation
Goal To evaluate the components of the Vermont Welfare Restructuring Project (WRP).
Program/Policy Description WRP is a "work-trigger" model of welfare reform, in which important elements of the safety net concept are preserved even though the type of public support is sharply altered. WRP is mandatory for welfare recipients.
Notes No notes reported.
 
Last Updated 09/30/02
Type of Summary Reviewed
External Reviewer(s) Dan Bloom (MDRC)
Contact(s) Dan Bloom (dan_bloom@mdrc.org)
MDRC
16 East 34th Street
19th Floor
(T) (212)-532-3200
(F) (212)-684-0832
Publications Department MDRC Publications (publications@mdrc.org)
MDRC
16 East 34th Street
19th Floor
(T) (212) 532-3200
(F) (212) 684-0832

Populations Studied

Target Population Recipients/participants/clients
Applicants
Subgroups Analyzed None
Sample Size and Unit 10,997 welfare applicant and recipient cases.

Random assignment to program and control groups. Statewide, 17,723 cases were randomly assigned through 12/96.

Additional notes: Families are assigned to three sets of rules: group 1, 20% of the caseload, qualifies for pre-reform services; group 2, 20% of caseload, is subject to all provisions of welfare reform except time limits or work requirements; group 3, 60% of caseload, is subject to all provisions of welfare reform.

Sites Studied

Barre, Vermont
Burlington, Vermont
Newport, Vermont
St. Albans, Vermont
Rutland, Vermont
Springfield, Vermont

Program Components, Policies, and Activities Evaluated

Employment activities

  • Job skills training
  • Job readiness activities
  • Job search
  • Job development
  • Employment Activities - misc.

Educational activities

  • Adult Basic Education (ABE) courses
  • GED courses
  • Post-secondary education

Financial incentives

  • Cash bonus for program completion
  • Earnings disregards
  • Elimination of 100 hour rule
  • Excluding the value of one vehicle
  • Increased asset limit
  • Financial Incentives - misc.

Program requirements

  • Work requirement
  • Community or alternative work
  • Mandatory JOBS for younger teens
  • Living arrangements for unwed pregnant or parenting minors
  • Program Requirements - misc.

Child support

  • Support paid directly to parent
  • Child support - misc.

Social/Support services

  • Transitional health benefits
  • Parenting classes/training
  • Social/Support Services - misc.

Time limits

  • Time Limits - misc.

Eligibility

  • Eligibility - misc.

Administration/Implementation

  • Administration/Implementation - misc.
Variation in program components across sites? Yes
Notes on program components Additional notes: Families are assigned to three sets of rules: group 1, 20% of the caseload, qualifies for pre-reform services; group 2, 20% of caseload, is subject to all provisions of welfare reform except time limits or work requirements; group 3, 60% of caseload, is subject to all provisions of welfare reform. Changes in child support: Child support payments are sent directly to welfare parents. Employment activities: The work requirement is strengthened in two-parent families; job development opportunities and job skills training provided by the state. Financial incentives: Earnings disregards are no longer time-limited; there is a disregard of $150 plus 25% of remaining gross income; elimination of specific eligibility criteria (100 hour rule and prior work history) for two-parent cases; changes in asset limitations and motor vehicle ownership rules. Program operations: Operational issues relative to implementation of WRP are studied.

Program requirements: Pregnant and parenting minors are required to live with parents or in an approved arrangement. Social/Support services: Additional 24 months of Medicaid coverage for families who become ineligible for ANFC (Vermont’s AFDC) due to increased earnings. More intensive case management, particularly with Reach Up (former JOBS program). Time limits: After 15 cumulative months (for two-parent households) or 30 cumulative months (for single-parent households), parents are required to work, either in unsubsidized jobs or in subsidized pay-for-work jobs community service employment (CSE) or mandatory job search.

Outcomes Assessed

Education

  • High school graduation/GED receipt

Employment

  • Job attainment
  • Job retention
  • Employment - misc.

Family and relationship outcomes

  • Births/pregnancies
  • Family formation and stability/Living arrangements
  • Family and relationship outcomes - misc.

Income security

  • Child support payments
  • Earnings
  • Food stamps receipt
  • Medicaid receipt
  • Welfare receipt
  • Income security - misc.

Housing

  • Housing - misc.

Attitudes towards work, welfare, and program

  • Attitudes towards work, welfare, and program - misc.

Service utilization

  • Service utilization - misc.

Program implementation

  • Program Implementation - misc.

Financial costs and benefits/cost-effectiveness

  • Financial costs and benefits/cost-effectiveness - misc.

Exit effects

  • Exit effects-misc.

Child Outcomes

  • Child academic outcomes

Types of Studies

Type Impact Study (Controlled Experiment)
Aim To determine whether and to what extent the interaction of financial incentives with time limits and related activities, particularly community service jobs, increases unsubsidized employment and earnings, job retention, and hours worked, and whether it affects the types of jobs and wage levels. To determine the effect of only changing financial incentives for ANFC (Vermont’s AFDC) single parents or two-parent cases.

To determine the extent to which WRP policies affect ANFC and food stamp receipt, income, self-sufficiency, and poverty. To determine the impact of WRP and its key components on various subgroups of welfare applicants and recipients.
 
Type Implementation/Process Study
Aim To determine the nature of the program being evaluated, the feasibility of replicating the program elsewhere, and the factors that contribute to the program’s successes or failures.
 
Type Cost-Benefit Study
Aim To use the implementation and process work to provide key input into estimating cost and the impact work for estimating benefits. To assess the benefits and costs of WRP from several perspectives.
 

Data Sources

Source Administrative data
Title AFDC monthly program extract files
Vermont unemployment insurance wage and benefit data
Sample Characteristics/Data Collection Files and data for 10,997 welfare applicants and recipients (both program and control group members) and 17,723 cases from non-research districts.
Collected from July 1992 to date.
Sites All sites.
Response Rate/Attrition Notes N/A
Additional Execution Notes No notes reported.
 
Source Administrative data
Title Background assignment data (Biweekly files, including case composition and computerized background survey data) and ACCESS data (Vermont’s automated eligibility system)
Sample Characteristics/Data Collection Files and background data for 10,997 welfare applicants and recipients (both program and control groups) and 17,723 cases from non-research districts.
Collected at time of assignment.
Sites All sites.
Response Rate/Attrition Notes N/A
Additional Execution Notes No notes reported.
 
Source Administrative data
Title Monthly food stamp program extract files
Sample Characteristics/Data Collection Data collected for 10,997 welfare applicants and recipients (both program and control groups) and 17,723 cases from non-research districts.
Collected from July 1994 to date.
Sites All sites.
Response Rate/Attrition Notes N/A
Additional Execution Notes No notes reported.
 
Source Administrative data
Title Monthly Medicaid eligibility files.
Cumulative child support receipts.
Child care data.
Data on Reach Up activities and participation.
Data on transitional child care support.
Unemployment Insurance Records.
Aggregate data on confirmed cases of child abuse and neglect.
Child Outcomes data.
Data on Program activities.
Sample Characteristics/Data Collection Files for 10,997 welfare applicants and recipients (both program and control groups).
17,723 files from non-research districts.
Data collection schedule not reported.
Sites All sites.
Response Rate/Attrition Notes N/A
Additional Execution Notes No notes reported.
 
Source Survey
Title Telephone survey to test understanding of WRP
Sample Characteristics/Data Collection 93 welfare recipients.
All members of program and control groups assigned between October 15 and 31, 1994.
Data collected approximately two months after assignment.
Sites All sites.
Response Rate/Attrition Notes 144 respondents fielded.
Reported response rate: 65%
Additional Execution Notes No notes reported.
 
Source Survey
Title Self-administered staff survey
Sample Characteristics/Data Collection Welfare and Reach Up staff.
82 eligibility staff, 72 Reach Up staff.
Sampling method not reported.
Data collected in 1996.
Sites All sites.
Response Rate/Attrition Notes Reported response rate: 90% plus
Additional Execution Notes No notes reported.
 
Source Focus Group
Title Focus Group
Sample Characteristics/Data Collection 40 single parent welfare recipient cases assigned to the group subject to a time limit in 8/94-9/94.
Collected February/March 1996.
Sites Barre, Vermont
St. Albans, Vermont
Response Rate/Attrition Notes 163 fielded.
Reported Response rate: 24.5%
Additional Execution Notes No notes reported.
 
Source Survey
Title In-person small-scale survey
Sample Characteristics/Data Collection All community service employment supervisors and their employees (number in sample not reported).
Data collected in 1998.
Sites All sites.
Response Rate/Attrition Notes Not yet available.
Additional Execution Notes No notes reported.
 
Source Survey
Title Mixed-mode 42-month survey
Sample Characteristics/Data Collection Welfare recipients (number in sample not reported).
Sampling method not reported.
Collected 42 months after assignment.
Sites All sites.
Response Rate/Attrition Notes 2000 completions expected (80% response rate)
Additional Execution Notes Completed.
 

Findings Available

Interim Implementation Findings
Interim Impact Findings
Final Impact Findings
Interim Descriptive/Analytical Findings

Findings

07/01/94: Vermont Welfare Restructuring Project Evaluation: Application
Interim Implementation Findings: "Implementation of both WRP and the associated evaluation has been on schedule and as planned"(33).
 
10/01/98: Vermont Welfare Restructuring Project Evaluation: Implementation and Early Impacts of Vermont's Welfare Restructuring Project
Interim Impact Findings:

The full WRP program — including both the incentives and the time limit — generated a modest increase in employment during the pre-time limit period. Sixty-eight percent of WRP group members worked at some point in the 21-month period compared with 63 percent of the ANFC group. In addition, the program slightly increased the rate of participation in Reach Up. WRP did not affect the rate of ANFC receipt — about 55 percent of each group were receiving ANFC at the end of the follow-up period — nor did it change the average amount of welfare received or people’s average combined income from public assistance and earnings. WRP’s time limit was necessary for generating impacts. WRP’s financial incentives alone had little or no impact on employment and slightly increased the proportion of people receiving ANFC during the last three months of the follow-up period. Adding the time limit to the incentives generated an increase in employment and a decrease in welfare receipt. In assessing these results, however, it is important to note that many of the benefits provided through WRP’s incentive package are also available, at least to some degree, to members of the ANFC group through other programs.

Longer-term results for single parents: A more substantial difference in the "treatment" provided to the three groups emerged when recipients in the WRP group began to approach the 30-month time limit. WRP group members are required to participate in job search activities during the two months before they are due to reach the time limit. Once they reach the limit, they must work in an unsubsidized job (if they can find one) or a community service job. To begin to capture the impact of WRP’s work mandates, the analysis looks at longer-term (33-month) results for people who entered the study early on.

Once recipients started reaching the time limit, WRP began to increase substantially the proportion of those who were working while on welfare. DSW records show that in Months 27 and 29 of the follow-up period there was only a modest difference between the WRP group and the ANFC group in the proportion who received ANFC and did not report employment. However, by Month 33 a substantial difference had emerged: 32 percent of ANFC group members were receiving ANFC and had no reported employment compared with only 23 percent of the WRP group. Thus, once the time limit began to take effect, WRP began to reduce substantially the number of people who relied solely on public aid — a key goal of the program. Although these longer-term results are promising, two caveats are necessary. First, the results are based on a small group of early enrollees; results for the full sample may be different. Second, because the longer-term data were drawn exclusively from DSW records, it is not possible to say whether WRP generated an increase in employment or only an increase in employment that was reported to the department. Staff are making a serious effort to implement the post-time limit work requirement, and few recipients appear to be falling through the cracks. Nevertheless, at any point in time a substantial proportion of recipients are neither working nor exempt from the work requirement, despite having passed the time limit. Detailed case studies indicate that frequent changes in the status of recipients, the absence of strong enforcement tools, and other factors make it very difficult for staff to ensure that everyone is working at all times. Perhaps the most surprising aspect of the post-time limit experience so far is that very few clients have entered community service employment slots. This is seen as an encouraging sign, because it means that a large majority of the clients who are meeting WRP’s work requirement are in unsubsidized jobs.

Results for two-parent families. The "treatment" difference among the three research groups may be smaller for two-parent families in the ANFC-Unemployed Parent (UP) program than it is for single-parent families. Although WRP’s changes in welfare eligibility rules make it substantially easier for certain groups of needy two-parent families to receive assistance, the potential impact of the time limit (15 months for ANFC-UP cases) is muted by the fact that principal wage earners in all three groups are subject to work-related mandates throughout their families’ time on welfare.2

WRP generated a modest increase in ANFC receipt among ANFC-UP families: 79 percent of families in the WRP group received ANFC benefits at some point in the follow-up period compared with 73 percent of families in the ANFC group. In addition, parents in the WRP group were somewhat more likely to work: 62 percent of principal earners in the WRP group worked in the last three months of the follow-up period compared with 57 percent in the ANFC group; however, this difference was not large enough to be confidently attributed to the new policy. Finally, WRP group members were somewhat more likely to participate in Reach Up, especially in job search activities.

Just under 10 percent of Vermont’s ANFC cases are two-parent families in which one parent is incapacitated. The able-bodied parent in such families is subject to the same time limit and work requirement rules as the sole parent in a single-parent family.

During the first 21 months of the follow-up period, WRP’s time limit increased employment among two-parent families with an incapacitated parent. In the last quarter of the follow-up period, 50 percent of families in the WRP group had at least one working parent, compared with 40 percent in the WRP Incentives Only group. Adding the time limit also increased the proportion of families who combined work and welfare: 21 percent in the WRP group, compared with 13 percent in the WRP Incentives Only group.

 
06/01/00: Vermont Welfare Restructuring Project: Forty-Two—Month Impacts of Vermont’s Welfare Restructuring Project
Interim Impact Findings:

Once single parents began to reach WRP’s 30-month work-trigger time limit, the program began to substantially increase employment rates and reduce the proportion of parents who received welfare without working.

The work-trigger time limit was necessary for producing impacts: WRP’s financial incentives alone generated no significant changes in employment or in-come for single-parent families.

WRP changed the composition of income for single-parent families: They re-lied more on earnings and less on cash assistance. However, because the de-crease in cash assistance largely offset the increase in earnings, the program did not affect these families’ total combined income from public assistance and earnings. These results do not include the federal or state earned income tax credits, which provide additional income to many working families.

WRP’s impacts for two-parent families with an incapacitated parent were generally similar to those for single-parent families.

WRP did not significantly increase employment or earnings among two-parent Unemployed Parent (UP) families, but the program’s incentives and changes in eligibility rules increased cash assistance receipt and payment amounts.

 
07/01/02: Vermont Welfare Restructuring Project: An Analysis of Vermont’s Community Service Employment Program
Interim Descriptive/Analytical Findings:

"Although WRP planners originally estimated that large numbers of welfare recipients would need CSE slots in order to meet the work requirement, in fact CSE was rarely used. Of more than 3,000 single parents analyzed as part of the WRP evaluation, only about 2 percent ever worked in a CSE position within roughly four years after enrollment. Most of the recipients who became subject to the work requirement were able to obtain unsubsidized jobs in the strong labor market of the late 1990s."

"CSE was designed to serve a dual purpose: (1) to give parents meaningful work in order to meet the WRP work requirement and (2) to improve participants’ ability to obtain unsubsidized jobs. MDRC’s survey found that parents who were placed in CSE slots generally had positive views about their experiences. Most thought that it was fair that they were required to work in a CSE assignment, and large majorities reported that they did meaningful work and increased their skills. Nearly 60 percent of respondents reported that they had worked in an unsubsidized job at some point since starting the CSE assignment."

"Most CSE supervisors also reported positive experiences with the program and felt that CSE employees were generally comparable to non-CSE employees doing similar work. Supervisors reported that they went beyond basic supervision to help participants address barriers to stable attendance."

 
09/01/02: Vermont Welfare Restructuring Project Evaluation: Final Report on Vermont's Welfare Restructuring Project
Final Impact Findings:

  • The full WRP program increased employment and reduced reliance on cash assistance for single-parent families, particularly in the period after some parents became subject to the work requirement.

  • WRP had little effect on family income, material hardship, children’s school performance, or other family and child outcomes.

  • The program’s work requirement was needed in order to generate impacts. WRP’s financial incentives alone did not lead to increases in employment or income, probably because the incentives were not substantially different from incentives under the prior rules.

  • WRP increased employment among most subgroups, but the increases were largest for the most disadvantaged sample members. WRP increased income for the least disadvantaged sample members.

  • WRP’s work requirement was implemented as planned, but, contrary to initial expectations, very few community service employment positions were needed.

  • The net cost of WRP was quite low, and the government’s spending on the program was more than offset by reduced public assistance payments; in other words, WRP saved money for taxpayers.

  • WRP generated few effects for two-parent families with an unemployed parent.
  •  

    Recommendations

    Vermont Welfare Restructuring Project Evaluation: Application (07/01/94)
    Recommendations not yet available.
     

    Existing Publications

    07/01/94 Vermont Welfare Restructuring Project Evaluation: Application MDRC
    10/01/98 Vermont Welfare Restructuring Project Evaluation: Implementation and Early Impacts of Vermont's Welfare Restructuring Project MDRC
    01/01/95 Vermont Welfare Restructuring Project Evaluation: Cross-State Study of Time-Limited Welfare MDRC
    06/01/00 Vermont Welfare Restructuring Project: Forty-Two—Month Impacts of Vermont’s Welfare Restructuring Project MDRC
    07/01/02 Vermont Welfare Restructuring Project: An Analysis of Vermont’s Community Service Employment Program MDRC
    09/01/02 Vermont Welfare Restructuring Project Evaluation: Final Report on Vermont's Welfare Restructuring Project MDRC