|
Vermont Welfare Restructuring Project Evaluation
General Information
View a brief abstract of this project.
View a complete, printer-friendly profile of this project.
Populations Studied
| Target Population |
Recipients/participants/clients
Applicants
|
| Subgroups Analyzed |
None
|
| Sample Size and Unit |
10,997 welfare applicant and recipient cases.
Random assignment to program and control groups.
Statewide, 17,723 cases were randomly assigned through 12/96.
Additional notes: Families are assigned to three sets of rules: group 1, 20% of the caseload, qualifies for pre-reform services; group 2, 20% of caseload, is subject to all provisions of welfare reform except time limits or work requirements; group 3, 60% of caseload, is subject to all provisions of welfare reform.
|
Sites Studied
Barre, Vermont
Burlington, Vermont
Newport, Vermont
St. Albans, Vermont
Rutland, Vermont
Springfield, Vermont
Program Components, Policies, and Activities Evaluated
Employment activities
- Job skills training
- Job readiness activities
- Job search
- Job development
- Employment Activities - misc.
Educational activities
- Adult Basic Education (ABE) courses
- GED courses
- Post-secondary education
Financial incentives
- Cash bonus for program completion
- Earnings disregards
- Elimination of 100 hour rule
- Excluding the value of one vehicle
- Increased asset limit
- Financial Incentives - misc.
Program requirements
- Work requirement
- Community or alternative work
- Mandatory JOBS for younger teens
- Living arrangements for unwed pregnant or parenting minors
- Program Requirements - misc.
Child support
- Support paid directly to parent
- Child support - misc.
Social/Support services
- Transitional health benefits
- Parenting classes/training
- Social/Support Services - misc.
Time limits
Eligibility
Administration/Implementation
- Administration/Implementation - misc.
| Variation in program components across sites? |
Yes
|
| Notes on program components |
Additional notes: Families are assigned to three sets of rules: group 1, 20% of the caseload, qualifies for pre-reform services; group 2, 20% of caseload, is subject to all provisions of welfare reform except time limits or work requirements; group 3, 60% of caseload, is subject to all provisions of welfare reform.
Changes in child support: Child support payments are sent directly to welfare parents.
Employment activities: The work requirement is strengthened in two-parent families; job development opportunities and job skills training provided by the state.
Financial incentives: Earnings disregards are no longer time-limited; there is a disregard of $150 plus 25% of remaining gross income; elimination of specific eligibility criteria (100 hour rule and prior work history) for two-parent cases; changes in asset limitations and motor vehicle ownership rules.
Program operations: Operational issues relative to implementation of WRP are studied.
Program requirements: Pregnant and parenting minors are required to live with parents or in an approved arrangement.
Social/Support services: Additional 24 months of Medicaid coverage for families who become ineligible for ANFC (Vermonts AFDC) due to increased earnings. More intensive case management, particularly with Reach Up (former JOBS program).
Time limits: After 15 cumulative months (for two-parent households) or 30 cumulative months (for single-parent households), parents are required to work, either in unsubsidized jobs or in subsidized pay-for-work jobs community service employment (CSE) or mandatory job search.
|
Outcomes Assessed
Education
- High school graduation/GED receipt
Employment
- Job attainment
- Job retention
- Employment - misc.
Family and relationship outcomes
- Births/pregnancies
- Family formation and stability/Living arrangements
- Family and relationship outcomes - misc.
Income security
- Child support payments
- Earnings
- Food stamps receipt
- Medicaid receipt
- Welfare receipt
- Income security - misc.
Housing
Attitudes towards work, welfare, and program
- Attitudes towards work, welfare, and program - misc.
Service utilization
- Service utilization - misc.
Program implementation
- Program Implementation - misc.
Financial costs and benefits/cost-effectiveness
- Financial costs and benefits/cost-effectiveness - misc.
Exit effects
Child Outcomes
Types of Studies
| Type |
Impact Study (Controlled Experiment)
|
| Aim |
To determine whether and to what extent the interaction of financial incentives with time limits and related activities, particularly community service jobs, increases unsubsidized employment and earnings, job retention, and hours worked, and whether it affects the types of jobs and wage levels.
To determine the effect of only changing financial incentives for ANFC (Vermonts AFDC) single parents or two-parent cases.
To determine the extent to which WRP policies affect ANFC and food stamp receipt, income, self-sufficiency, and poverty.
To determine the impact of WRP and its key components on various subgroups of welfare applicants and recipients.
|
| |
| Type |
Implementation/Process Study
|
| Aim |
To determine the nature of the program being evaluated, the feasibility of replicating the program elsewhere, and the factors that contribute to the programs successes or failures.
|
| |
| Type |
Cost-Benefit Study
|
| Aim |
To use the implementation and process work to provide key input into estimating cost and the impact work for estimating benefits.
To assess the benefits and costs of WRP from several perspectives.
|
| |
Data Sources
| Source |
Administrative data
|
| Title |
AFDC monthly program extract files
Vermont unemployment insurance wage and benefit data
|
| Sample Characteristics/Data Collection |
Files and data for 10,997 welfare applicants and recipients (both program and control group members) and
17,723 cases from non-research districts.
Collected from July 1992 to date.
|
| Sites |
All sites.
|
| Response Rate/Attrition Notes |
N/A
|
| Additional Execution Notes |
No notes reported.
|
| |
| Source |
Administrative data
|
| Title |
Background assignment data (Biweekly files, including case composition and computerized background survey data) and ACCESS data (Vermonts automated eligibility system)
|
| Sample Characteristics/Data Collection |
Files and background data for 10,997 welfare applicants and recipients (both program and control groups) and
17,723 cases from non-research districts.
Collected at time of assignment.
|
| Sites |
All sites.
|
| Response Rate/Attrition Notes |
N/A
|
| Additional Execution Notes |
No notes reported.
|
| |
| Source |
Administrative data
|
| Title |
Monthly food stamp program extract files
|
| Sample Characteristics/Data Collection |
Data collected for 10,997 welfare applicants and recipients (both program and control groups) and
17,723 cases from non-research districts.
Collected from July 1994 to date.
|
| Sites |
All sites.
|
| Response Rate/Attrition Notes |
N/A
|
| Additional Execution Notes |
No notes reported.
|
| |
| Source |
Administrative data
|
| Title |
Monthly Medicaid eligibility files. Cumulative child support receipts. Child care data. Data on Reach Up activities and participation. Data on transitional child care support. Unemployment Insurance Records. Aggregate data on confirmed cases of child abuse and neglect. Child Outcomes data. Data on Program activities.
|
| Sample Characteristics/Data Collection |
Files for 10,997 welfare applicants and recipients (both program and control groups).
17,723 files from non-research districts.
Data collection schedule not reported.
|
| Sites |
All sites.
|
| Response Rate/Attrition Notes |
N/A
|
| Additional Execution Notes |
No notes reported.
|
| |
| Source |
Survey
|
| Title |
Telephone survey to test understanding of WRP
|
| Sample Characteristics/Data Collection |
93 welfare recipients.
All members of program and control groups assigned between October 15 and 31, 1994.
Data collected approximately two months after assignment.
|
| Sites |
All sites.
|
| Response Rate/Attrition Notes |
144 respondents fielded. Reported response rate:
65%
|
| Additional Execution Notes |
No notes reported.
|
| |
| Source |
Survey
|
| Title |
Self-administered staff survey
|
| Sample Characteristics/Data Collection |
Welfare and Reach Up staff.
82 eligibility staff, 72 Reach Up staff.
Sampling method not reported.
Data collected in 1996.
|
| Sites |
All sites.
|
| Response Rate/Attrition Notes |
Reported response rate:
90% plus
|
| Additional Execution Notes |
No notes reported.
|
| |
| Source |
Focus Group
|
| Title |
Focus Group
|
| Sample Characteristics/Data Collection |
40 single parent welfare recipient cases assigned to the group subject to a time limit in 8/94-9/94.
Collected February/March 1996.
|
| Sites |
Barre, Vermont
St. Albans, Vermont
|
| Response Rate/Attrition Notes |
163 fielded. Reported Response rate:
24.5%
|
| Additional Execution Notes |
No notes reported.
|
| |
| Source |
Survey
|
| Title |
In-person small-scale survey
|
| Sample Characteristics/Data Collection |
All community service employment supervisors and their employees (number in sample not reported).
Data collected in 1998.
|
| Sites |
All sites.
|
| Response Rate/Attrition Notes |
Not yet available.
|
| Additional Execution Notes |
No notes reported.
|
| |
| Source |
Survey
|
| Title |
Mixed-mode 42-month survey
|
| Sample Characteristics/Data Collection |
Welfare recipients (number in sample not reported).
Sampling method not reported.
Collected 42 months after assignment.
|
| Sites |
All sites.
|
| Response Rate/Attrition Notes |
2000 completions expected (80% response rate)
|
| Additional Execution Notes |
Completed.
|
| |
Findings Available
Interim Implementation Findings
Interim Impact Findings
Final Impact Findings
Interim Descriptive/Analytical Findings
Findings
|
07/01/94:
Vermont Welfare Restructuring Project Evaluation: Application
|
|
Interim Implementation Findings:
"Implementation of both WRP and the associated evaluation has been on schedule and as planned"(33).
|
| |
|
10/01/98:
Vermont Welfare Restructuring Project Evaluation: Implementation and Early Impacts of Vermont's Welfare Restructuring Project
|
|
Interim Impact Findings:
The full WRP program including both the incentives and the time limit generated a modest increase in employment during the pre-time limit period. Sixty-eight percent of WRP group members worked at some point in the 21-month period compared with 63 percent of the ANFC group. In addition, the program slightly increased the rate of participation in Reach Up. WRP did not affect the rate of ANFC receipt about 55 percent of each group were receiving ANFC at the end of the follow-up period nor did it change the average amount of welfare received or peoples average combined income from public assistance and earnings. WRPs time limit was necessary for generating impacts. WRPs financial incentives alone had little or no impact on employment and slightly increased the proportion of people receiving ANFC during the last three months of the follow-up period. Adding the time limit to the incentives generated an increase in employment and a decrease in welfare receipt. In assessing these results, however, it is important to note that many of the benefits provided through WRPs incentive package are also available, at least to some degree, to members of the ANFC group through other programs.
Longer-term results for single parents: A more substantial difference in the "treatment" provided to the three groups emerged when recipients in the WRP group began to approach the 30-month time limit. WRP group members are required to participate in job search activities during the two months before they are due to reach the time limit. Once they reach the limit, they must work in an unsubsidized job (if they can find one) or a community service job. To begin to capture the impact of WRPs work mandates, the analysis looks at longer-term (33-month) results for people who entered the study early on.
Once recipients started reaching the time limit, WRP began to increase substantially the proportion of those who were working while on welfare. DSW records show that in Months 27 and 29 of the follow-up period there was only a modest difference between the WRP group and the ANFC group in the proportion who received ANFC and did not report employment. However, by Month 33 a substantial difference had emerged: 32 percent of ANFC group members were receiving ANFC and had no reported employment compared with only 23 percent of the WRP group. Thus, once the time limit began to take effect, WRP began to reduce substantially the number of people who relied solely on public aid a key goal of the program. Although these longer-term results are promising, two caveats are necessary. First, the results are based on a small group of early enrollees; results for the full sample may be different. Second, because the longer-term data were drawn exclusively from DSW records, it is not possible to say whether WRP generated an increase in employment or only an increase in employment that was reported to the department. Staff are making a serious effort to implement the post-time limit work requirement, and few recipients appear to be falling through the cracks. Nevertheless, at any point in time a substantial proportion of recipients are neither working nor exempt from the work requirement, despite having passed the time limit. Detailed case studies indicate that frequent changes in the status of recipients, the absence of strong enforcement tools, and other factors make it very difficult for staff to ensure that everyone is working at all times. Perhaps the most surprising aspect of the post-time limit experience so far is that very few clients have entered community service employment slots. This is seen as an encouraging sign, because it means that a large majority of the clients who are meeting WRPs work requirement are in unsubsidized jobs.
Results for two-parent families. The "treatment" difference among the three research groups may be smaller for two-parent families in the ANFC-Unemployed Parent (UP) program than it is for single-parent families. Although WRPs changes in welfare eligibility rules make it substantially easier for certain groups of needy two-parent families to receive assistance, the potential impact of the time limit (15 months for ANFC-UP cases) is muted by the fact that principal wage earners in all three groups are subject to work-related mandates throughout their families time on welfare.2
WRP generated a modest increase in ANFC receipt among ANFC-UP families: 79 percent of families in the WRP group received ANFC benefits at some point in the follow-up period compared with 73 percent of families in the ANFC group. In addition, parents in the WRP group were somewhat more likely to work: 62 percent of principal earners in the WRP group worked in the last three months of the follow-up period compared with 57 percent in the ANFC group; however, this difference was not large enough to be confidently attributed to the new policy. Finally, WRP group members were somewhat more likely to participate in Reach Up, especially in job search activities.
Just under 10 percent of Vermonts ANFC cases are two-parent families in which one parent is incapacitated. The able-bodied parent in such families is subject to the same time limit and work requirement rules as the sole parent in a single-parent family.
During the first 21 months of the follow-up period, WRPs time limit increased employment among two-parent families with an incapacitated parent. In the last quarter of the follow-up period, 50 percent of families in the WRP group had at least one working parent, compared with 40 percent in the WRP Incentives Only group. Adding the time limit also increased the proportion of families who combined work and welfare: 21 percent in the WRP group, compared with 13 percent in the WRP Incentives Only group.
|
| |
|
06/01/00:
Vermont Welfare Restructuring Project: Forty-TwoMonth Impacts of Vermonts Welfare Restructuring Project
|
|
Interim Impact Findings:
Once single parents began to reach WRPs 30-month work-trigger time limit,
the program began to substantially increase employment rates and reduce the
proportion of parents who received welfare without working.
The work-trigger time limit was necessary for producing impacts: WRPs financial
incentives alone generated no significant changes in employment or in-come
for single-parent families.
WRP changed the composition of income for single-parent families: They re-lied
more on earnings and less on cash assistance. However, because the de-crease
in cash assistance largely offset the increase in earnings, the program did
not affect these families total combined income from public assistance and
earnings. These results do not include the federal or state earned income tax
credits, which provide additional income to many working families.
WRPs impacts for two-parent families with an incapacitated parent were generally
similar to those for single-parent families.
WRP did not significantly increase employment or earnings among two-parent
Unemployed Parent (UP) families, but the programs incentives and changes in
eligibility rules increased cash assistance receipt and payment amounts.
|
| |
|
07/01/02:
Vermont Welfare Restructuring Project: An Analysis of Vermonts Community Service Employment Program
|
|
Interim Descriptive/Analytical Findings: "Although WRP planners originally estimated that large numbers of welfare recipients would need CSE slots in order to meet the work requirement, in fact CSE was rarely used. Of more than 3,000 single parents analyzed as part of the WRP evaluation, only about 2 percent ever worked in a CSE position within roughly four years after enrollment. Most of the recipients
who became subject to the work requirement were able to obtain unsubsidized jobs in the strong labor market of the late 1990s." "CSE was designed to serve a dual purpose: (1) to give parents meaningful work in order to meet the WRP work requirement and (2) to improve participants ability to obtain unsubsidized jobs. MDRCs survey found that parents who were placed in CSE slots generally had positive views about their experiences. Most thought that it was fair that they were required
to work in a CSE assignment, and large majorities reported that they did meaningful work and increased their skills. Nearly 60 percent of respondents reported that they had worked in an unsubsidized job at some point since starting the CSE assignment." "Most CSE supervisors also reported positive experiences with the program and felt that CSE employees were generally comparable to non-CSE employees doing similar work. Supervisors
reported that they went beyond basic supervision to help participants address barriers to stable attendance."
|
| |
|
09/01/02:
Vermont Welfare Restructuring Project Evaluation: Final Report on Vermont's Welfare Restructuring Project
|
|
Final Impact Findings:
The full WRP program increased employment and reduced reliance on cash assistance for single-parent families, particularly in the period after some parents became subject to the work requirement.
WRP had little effect on family income, material hardship, childrens school performance, or other family and child outcomes.
The programs work requirement was needed in order to generate impacts. WRPs financial incentives alone did not lead to increases in employment or income, probably because the incentives were not substantially different from incentives under the prior rules.
WRP increased employment among most subgroups, but the increases were largest for the most disadvantaged sample members. WRP increased income for the least disadvantaged sample members.
WRPs work requirement was implemented as planned, but, contrary to initial expectations, very few community service employment positions were needed.
The net cost of WRP was quite low, and the governments spending on the program was more than offset by reduced public assistance payments; in other words, WRP saved money for taxpayers.
WRP generated few effects for two-parent families with an unemployed parent.
|
| |
Recommendations
Existing Publications
|