|
Texas Achieving Change for Texans (ACT): Evaluation of the Texas Welfare Reform Waiver
General Information
View a brief abstract of this project.
View a complete, printer-friendly profile of this project.
| Evaluator(s) |
Texas Department of Human Services
Ray Marshall Center for the Study of Human Resources, University of Texas at Austin
School of Social Work, University of Texas at Austin
|
| Investigator(s) |
Deanna Schexnayder
(Lyndon B. Johnson School of Public Affairs, University of Texas)
|
| Funder(s) |
Texas Department of Human Services
US Department of Health and Human Services
|
| |
| Domain |
Income Security/TANF
|
| Status |
Completed (final report released)
|
| Duration |
Jul 1997 - Jul 2003
|
| Type |
Research and/or Program Evaluation
Policy Analysis
|
| Goal |
The major objectives of the ACT evaluation were:
- To document how well the demonstration was implemented;
- To determine the impacts of the ACT waiver policies on a number of public assistance, economic and child outcomes; and to report participants views of welfare reform.
|
| Program/Policy Description |
The Achieving Change for Texans (ACT) demonstration was created after the enactment of Texas HB1863 and operated in several locations from June 1996 to March 2002. It was one of the last AFDC state waivers to be approved before the passage of PRWORA. The waiver attempts to assist participants in achieving independence from welfare by putting stronger emphasis on employment, training, temporary assistance and support services.
The ACT demonstration included the following components:
- State Time Limits- Adult TANF recipients were assigned one of three time limit tiers (12, 24, 36 months) based on their educational attainment and work history.
- Expanded TANF eligibility rules- ACT expanded TANF eligibility for certain low-income families.
- Personal Responsibility Agreement Caretakers were required to sign a personal responsibility agreement (PRA) as a condition of TANF eligibility. In counties with a Choices program, state time limits also applied. The PRA states the client will:
- Cooperate with child support requirements
- Provide immunizations and regular check ups for children
- Refrain from voluntarily quitting their job
- Participate in an employment services program.
- Refrain from drug use and alcohol abuse
- Provide proof of school attendance for each child
- Participate in parenting skills classes if referred
Those not complying received financial penalties.
- One time cash payments in lieu of TANF Allowed certain TANF eligible families who also met certain criteria crisis to obtain a one time payment of $1000 instead of TANF. This benefit was available to all eligible families and was not designed as a randomized experiment.
|
| Notes |
No notes reported.
|
| |
| Last Updated |
11/16/05
|
| Type of Summary |
Reviewed
|
| External Reviewer(s) |
Deanna Schexnayder
(Lyndon B. Johnson School of Public Affairs, University of Texas)
|
| Contact(s) |
Deanna Schexnayder (dschex@uts.cc.utexas.edu)
Lyndon B. Johnson School of Public Affairs, University of Texas
Center for the Study of Human Resources
Mail Code: A1300
(T) (512)-471-2193
(F) (512)-471-0585
|
| Submitter(s) |
Deanna Schexnayder (dschex@uts.cc.utexas.edu)
Lyndon B. Johnson School of Public Affairs, University of Texas
Center for the Study of Human Resources
Mail Code: A1300
(T) (512)-471-2193
(F) (512)-471-0585
|
Populations Studied
| Target Population |
Recipients/participants/clients
Low-income households
|
| Sample Size and Unit |
N = 44,852 individuals randomly assigned to either the experimental group or control group with one of the following components: |
Sites Studied
Time limit sites: Bexar County, TexasTime Limits plus Personal Responsibility Agreement Sites: Beaumont, Texas Corpus Christi, Texas (Dillon Street Office) El Paso, Texas (Clint Office) Odessa, Texas Personal Responsibility Agreement Sites: Hondo, Texas Huntsville, Texas Lockhart, Texas Luling, Texas AFDC One-Time Sites: Texas (statewide)
Program Components, Policies, and Activities Evaluated
Financial incentives
- Earnings disregards
- Transitional income benefits
- Direct payment of rent to recipient (not landlord)
Financial disincentives/Sanctions
- Reduced benefits for non-compliance
Program requirements
- Work requirement
- Child support order
- Parenting or social contract
- School attendance
- Immunizations for children
Social/Support services
- Transitional child care
- Transitional health benefits
Administration/Implementation
- Simplification of program rules and procedures
- Program enforcement of sanctions
Employment activities
- Employment policies linked to treatment
Time limits
Eligibility
Educational activities
| Variation in program components across sites? |
Yes
|
| Notes on program components |
Educational Activities- As part of the Personal Responsibilty Agreement, attendance is required to parenting classes if referred. Eligibility- Expanded eligibility rules including the disregard of childrens earnings and resources in the calculation of family benefits, increased resource limits permitted for eligibility determination, and the elimination of the work history requirement and 100-hour work rule for TANF-Unemployed Parent (TANF-UP) families. Employment Activities- As part of the personal responsibility agreement, a client could not voluntarily give up a job. Financial Incentives: Earnings disregards- Disregard of childrens earnings and resources in calculation of family benefits. Direct Payment to Recipient One Time Cash payment in lieu of TANF. Transitional income benefits-Time limited transitional cash assistance ranging from 12-36 months depending on the recipients work history and educational attainment. Program Requirements: Personal Responsibility Agreement requirements include:Choices program attendance; Child support; Health screenings and immunizations for children; School attendance; Parenting skills classes; Refrain from selling and abusing illegal substances; not voluntarily quitting any job that offers more than 30 hours of paid work. Support Services: Time limited Transitional benefits- 12 months of transitional childcare and Medicaid for those who have reached the time limit. 18 months for those who voluntarily enter the CHOICES program. Time Limits: Time-limited benefits-Three tiered (12, 24, 36 months) state TANF limit benefits
|
Outcomes Assessed
Benefit termination
Education
Employment
Income security
- Child support payments
- Earnings
- Food stamps receipt
- Medicaid receipt
- Welfare receipt
- Overall income
Service utilization
- Service utilization - misc.
Adult outcomes
Child Outcomes
Types of Studies
| Type |
Implementation/Process Study
|
| Aim |
To provide a description of the program and its implementation.
|
| |
| Type |
Impact Study (Controlled Experiment)
|
| Aim |
To compare differences in outcomes for individuals in the control groups in each pilot and experimental group.
|
| |
| Type |
Descriptive/Analytical Study
|
| Aim |
To provide an in-depth understanding of clients experiences with state time limits through intensive interviews.
|
| |
Data Sources
| Source |
Administrative data
|
| Title |
Texas Education Agency Data
|
| Sample Characteristics/Data Collection |
N= 44,583 TANF recipients
|
| Sites |
Texas
|
| Response Rate/Attrition Notes |
Not applicable.
|
| Additional Execution Notes |
Information collected includes: school attendance records as well as student assessment scores. Data extracted from the Public Education Information Management Systems (PEIMS) database. Identification of individuals was prohibited, so a deidentified approach was used for this data.
|
| |
| Source |
Administrative data
|
| Title |
Texas Department of Human Services Data
|
| Sample Characteristics/Data Collection |
N=44,853 TANF recipients
|
| Sites |
Texas
|
| Response Rate/Attrition Notes |
Not applicable
|
| Additional Execution Notes |
Extracted from the DHS SAVERR data system, the main repository of client and case information.Information collected includes: monthly benefit receipt information, cumulative warrant files containing records of actual paid cash assistance to clients, transaction files which describing of TANF applications or re-certifications, penalty files, benefits ticked files, and child care management services. Data was collected from June 1994 to December 1997.
|
| |
| Source |
Administrative data
|
| Title |
Texas Workforce Commission Data
|
| Sample Characteristics/Data Collection |
N=44,853 TANF recipients
|
| Sites |
Texas
|
| Response Rate/Attrition Notes |
Not applicable.
|
| Additional Execution Notes |
Information collected includes: earnings data, subsidized child care usage, Choices participation data, Job Partnership Training Act data, Welfare to Work program data.
|
| |
| Source |
Administrative data
|
| Title |
Texas Office of the Attorney General Data
|
| Sample Characteristics/Data Collection |
N=44,853 TANF recipients
|
| Sites |
Texas
|
| Response Rate/Attrition Notes |
Not applicable.
|
| Additional Execution Notes |
Information collected includes: child support- related data. Data prior to September 1997 was not available.
|
| |
| Source |
Administrative data
|
| Title |
Texas Department of Health data
|
| Sample Characteristics/Data Collection |
Children of the N= 44,583 TANF recipients
|
| Sites |
Texas
|
| Response Rate/Attrition Notes |
Not applicable.
|
| Additional Execution Notes |
Information includes: Immunization information for children.Identification of individuals was prohibited, so a deidentified approach was used for this data.
|
| |
| Source |
Administrative data
|
| Title |
Texas Department of Protective and Regulatory Services Data
|
| Sample Characteristics/Data Collection |
N= 44,583 TANF recipients
|
| Sites |
Texas
|
| Response Rate/Attrition Notes |
Not applicable.
|
| Additional Execution Notes |
Information collected included: data on child abuse and neglect; placement of children into foster care. Data extracted from the CAPS data system.
|
| |
| Source |
Interview
|
| Title |
Interviews
|
| Sample Characteristics/Data Collection |
N= 182 households who received a one time payment
|
| Sites |
Texas
|
| Response Rate/Attrition Notes |
Conducted interviews with 55 of these households.
|
| Additional Execution Notes |
Conducted to provide in-depth understanding of clients experiences with state time limits and the TANF One-Time program. The interviews focused on the clients economic and family situations.
|
| |
| Source |
Program descriptions and documents
|
| Title |
Policy Documents
|
| Sample Characteristics/Data Collection |
Not applicable.
|
| Sites |
Texas
|
| Response Rate/Attrition Notes |
Not applicable.
|
| Additional Execution Notes |
Not applicable
|
| |
| Source |
Survey
|
| Title |
Self administered survey: Client mail survey
|
| Sample Characteristics/Data Collection |
N= 44,583 TANF recipients
|
| Sites |
Texas
|
| Response Rate/Attrition Notes |
Not reported.
|
| Additional Execution Notes |
Not reported.
|
| |
| Source |
Field Research
|
| Title |
Site Visits
|
| Sample Characteristics/Data Collection |
Local pilot TDHS offices
|
| Sites |
Texas
|
| Response Rate/Attrition Notes |
Not applicable.
|
| Additional Execution Notes |
Interviewed and observed staff interacting with clients. First site visits were in 1997; Second visits were in 1999 and 2000.
|
| |
Findings Available
Interim Implementation Findings
Final Implementation Findings
Interim Impact Findings
Final Impact Findings
Findings
|
01/01/03:
Texas Achieving Change for Texans: Evaluation of the Texas Welfare Reform Waiver: Final Summary Report
|
Final Impact Findings:
- Impacts on public assistance receipts from the ACT demonstration were small but significant.
- The ACT demonstration increased employment rates for some groups but had no effect on caretakers earnings.
- Weak overall impacts sometimes masked subgroup differences, especially by tier group.
- Staff and clients support the concept of time limits but the rules are too complex to understand.
- The interaction of state and federal time limits will result in the most disadvantaged families being the first to reach lifetime time limits on Texas TANF receipt.
- The increased use of financial penalties did not change most of the behaviors governed by the personal responsibility agreement.
- Most of the TANF caseload decline from 1995-1999 was not due to ACT waiver provisions.
- Impacts from this demonstration differ from those in other states but the mix of services is not comparable.
- A number of factors may have contributed to the small size of the impacts of the demonstration.
- The structure of TX time limit policies with its many exemptions from state time limits.
- Client confusion about the details and intent of both the time limit and PRA policies
- Clients paying more attention to their immediate needs rather than future consequences embedded in these policies.
- The exclusion of policies that supported employment from the set of policies included in the ACT demonstration
More specifically: - Texas time limits caused small reductions in TANF receipt, slight increases in enrollment in Medicaid and transitional benefits but no change in use of food stamps.
- Persons facing TANF time limits received PRA penalties less often than other caretakers but differences were very small. For both groups, about two months of every year on TANF were spent in penalty status.
- The impacts of time limits differed by tier.
- Time limits caused a very small increase in caretaker employment but had no effect on overall quarterly earnings. Time limits affected Choices participation differently for short and long-term recipients and by tier.
- Time limits slightly increased the number of months in which child support was collected but produced no differences in other family or child outcomes.
- Expanded TANF eligibility rules allowed more working but very poor two-parent families onto TANF in the site with the highest share of Hispanic families.
- The personal responsibility agreement rules resulted in large increases in financial penalties, compared to earlier TANF sanctions.
- The combination of state time limits and the PRA produced small gains in caretaker employment and total family earnings, but had no impact on caretaker earnings.
- The combination of time limits and the personal responsibility agreement caused small increases in child support collections but few impacts on other family and child measures. This lack of impacts occurred even though many penalties were imposed for not complying with PRA provisions related to these outcomes.
- The personal responsibility agreement produced no overall impacts on the use of childrens TANF or Medicaid but increased caretakers time on TANF and Medicaid due to PRA rules. Use of food stamps declined for families subject to PRA
- Families subject to the PRA spent more time in penalty status.
- The PRA produced no overall impact on employment or earnings.
- No impacts were found in school attendance rates, most of the child support measures, or immunization rates, despite experimental groups being subject to PRA penalties in this area.
- Families typically needed one time payments due to losing their unemployment and used these payments to cover a one time emergency expense or to purchase or repair a vehicle.
- One time payments produced in few changes in household budgeting, employment, access to education and training, or access to child care.
- One time payments were not used to support persons outside the household.
Final Implementation Findings: - An automated system assigned and tracked participation in this demonstration properly. This system provided consistency during a period when eligibility workers did not fully understand the complex rules of the ACT demonstration.
- Exemption from workforce services was the main reason that clocks did not ‘tick in the two experiments with state time limits.
- Staff initially had difficulty understanding and explaining ACT time limit provisions to clients, but their performance in this area improved over time.
- Clients understood that there were time limits but few knew what would happen to their benefits (TANF, food stamps, Medicaid) when they reached theirs.
- Workers explained personal responsibility agreement provisions accurately, but clients still did not understand the intent of the PRA or the consequences of not complying with its requirements.
|
| |
|
01/01/03:
Texas Achieving Change for Texans: Evaluation of the Texas Welfare Reform Waiver: Final Impact Report
|
Final Impact Findings:
Time Limits: - After over five years of operation, the time limits experiment produced statistically significant but small reductions in TANF receipt coupled with small increases in the use of Medicaid and transitional benefits.
- Employment rates increased slightly but self-sufficiency earnings declined slightly.
- Few impacts on workforce development participation or family and child indicators were observed.
- Reduced TANF use and employment and child support collections gains were greatest among those who were best prepared to enter the workforce and those with short histories of welfare receipt.
Responsibilities, Employment and Resources:Choices Program: - Three of the four RER sites in the Choices counties produced significant but varying impacts on welfare dynamics, large increases in financial penalties, slight gains in employment rates and family earnings, small reductions in Choices participation, increased use of child care subsidies and collection of child support but no impact on other adult and child outcomes.
Non Choices counties:- Non choices counties showed no consistent effects on the use of TANF benefits, slightly increased Medicaid receipt, and reduced the use of food stamps.
- Although there were no overall gains for employment or earnings, both increased for Tier 3 caretakers.
- While no differences were observed for families, experimental families used subsidized child care more often.
|
| |
|
12/01/98:
Texas Achieving Change for Texans: Evaluation of the Texas Welfare Reform Waiver: Net Impacts
|
|
Interim Impact Findings: Time Limit experiment - Test of random assignment revealed no significant differences between the two groups.
- After analyzing welfare dynamics, self-sufficiency, participation in workforce development services, and use of subsidized child care, positive net impacts were observed only for transfer from TANF cash benefits to transitional benefits and the percentage of cases using subsidized child care each month.
RER Choices Experiment - Tests of random assignment revealed no significant differences between the two groups.
- In the first 19 months of the RER experiment in Choices counties, a statistically significant difference in the proportion of time spent on welfare was observed, with the experimental group spending less time on TANF than their counterparts in the control.
- There was a relatively small difference in the overall caretaker exit rates for the two groups.
- A statistically significant difference in the rate of welfare recidivism in the year following exit was observed between the experimental and control groups.
- A small but significantly significant difference in the rate of Choices participation is observed.
- There was no significantly significant difference in the rate of child care usage among the two groups.
- A statistically significant difference was shown in the rate of transfer to medical assistance-only status, transitional benefit-only status, and to payee only status.
RER Non-Choices experiment - While no significant differences existed between the sizes of the groups, there were some differences in the demographics of the groups.
- Analysis of welfare dynamics from the first year found that the experimental group spent significantly less time on TANF than their counterparts.
- No statistically significant differences were found for any of the other welfare exit measures.
- No statistically significant differences were found for employment, earnings, or childcare measures.
|
| |
Recommendations
|
Texas Achieving Change for Texans: Evaluation of the Texas Welfare Reform Waiver: Final Summary Report (01/01/03)
|
- Texas time limit policies should be simplified and the groups to whom they apply should be re-examined.
- In their current form, personal responsibility agreement penalties in TX have little value as a behavior modification tool for affected families and should be re-evaluated.
- The implications of the increased number of child-only cases on low income families and TANF related policies should be explored.
- Existing TANF policies should be examined to assess whether they meet the needs of long term TANF recipients and those with more limited workforce qualifications.
|
| |
Existing Publications
|