|
Iowa Family Investment Program (FIP) Evaluation
General Information
View a brief abstract of this project.
View a complete, printer-friendly profile of this project.
| Evaluator(s) |
Mathematica Policy Research, Inc.
|
| Investigator(s) |
Thomas Fraker
(Mathematica Policy Research, Inc.)
|
| Sponsor(s) |
Iowa Department of Human Services
|
| Funder(s) |
US Department of Health and Human Services
|
| Subcontractor(s) |
Institute for Social and Economic Development
|
| |
| Domain |
Income Security/TANF
Child/Family
|
| Status |
Completed with continuing analysis
|
| Duration |
Oct 1997 - Jun 2002
|
| Type |
Research and/or Program Evaluation
|
| Goal |
To evaluate Iowa's Family Investment Program (FIP)
|
| Program/Policy Description |
Iowas FIP replaced the former Aid to Families with Dependent Children (AFDC) program in Iowa on October 1, 1993. FIP reflects a broad agreement among Iowa welfare policymakers that the previous program should be replaced from one which emphasized income maintenance to one that emphasizes employment and client responsibility. FIP includes the Limited Benefit Plan (LBP) to which cases that fail to sign or meet the requirements of a written Family Investment Agreement (FIA) are assigned, and the PROMISE JOBS employment and training program. FIPs major provisions include: providing financial incentives and support for employment; requiring participants to take steps toward self-sufficiency; encouraging formation and preservation of two-parent families; imposing stiffer consequences; and encouraging productive saving and asset accumulation.
|
| Notes |
See project summary of Iowa's Limited Benefit Plan (Mathematica). The Iowa State Welfare Reform Evaluation Track 2 project, which complements the Iowa's Family Investment Program (FIP),
consists of two studies -a study of repeat limited benefit plan (LBP)
assignment and a study of post-employment services.
|
| |
| Last Updated |
12/13/02
|
| Type of Summary |
Reviewed
|
| External Reviewer(s) |
Thomas Fraker
(Mathematica Policy Research, Inc.)
|
| Contact(s) |
Thomas Fraker (not reported)
Mathematica Policy Research, Inc.
P.O. Box 2393
(T) (202) 484-4698
(F) (609)-799-0005
|
| Publications Department |
Jacqueline Allen (jallen@mathematica-mpr.com)
Mathematica Policy Research, Inc.
P.O. Box 2393
(T) (609)-275-2350
(F) (609)-799-0005
|
Populations Studied
| Sample Size and Unit |
7,178 FIP recipient cases (cases that were receiving public assistance in September 1993). Random assignment to treatment (n=4,800) and control (n=2,378) group.
4,000 welfare applicants (cases that applied for assistance on of after October 1993 without regard for whether applications were approved or denied). Random assignment to treatment (n=2,781) or control (n=1,409) group.
1,858 ongoing Food Stamp only (FSO) cases.
Random assignment to treatment (n=1,240) and control (n=618) groups.
3,141 applicant Food Stamp cases. Random assignment to treatment (n=2,060) and control (n=1,081) groups.
|
Sites Studied
Urban counties:
Black Hawk County, Iowa
Linn County, Iowa
Woodbury County, Iowa
Polk County, Iowa
Pottawattamie County, Iowa
Rural Counties:
Clinton County, Iowa
Des Moines County, Iowa
Jackson County, Iowa
Jones County, Iowa
Program Components, Policies, and Activities Evaluated
Employment activities
- Job skills training
- Employment Activities - misc.
Financial incentives
- Earnings disregards
- Excluding the value of one vehicle
- Increased asset limit
- Individual Development Account (IDA)
Financial disincentives/Sanctions
- Reduced benefits for non-compliance
Program requirements
- Work requirement
- Parenting or social contract
Social/Support services
Administration/Implementation
- Changes in welfare office environment/culture
- Development of new welfare policies
- Administration/Implementation - misc.
| Variation in program components across sites? |
No
|
| Notes on program components |
Employment Activities: PROMISE JOBS is an employment and training program which also provide post-employment services.
Financial Disincentives/Sanctions: Clients who fail to sign or follow through with the provisions of a Family Investment Agreement (FIA) are assigned to the Limited Benefit Plan (LBP), which provides a reduced level of cash assistance for three months followed by no cash assistance for the entire family for six months.
Financial Incentives: Work expense disregards and earned income disregards are increased. Asset limit increased to $2,000 for applicants and $5,000 for recipients. Vehicle asset limit increased to $3,000 in 1994 (with annual increases based on the Consumer Price Index) for every adult and working teenage household member. Income, interest, and dividends deposited in an Individual Development Account (IDA) are disregarded when income and asset eligibility are determined.
Program operations/implementation: Study examines developing Iowas TANF program; policy changes; and changes in administrative procedures and services.
Program Requirements: Able-bodied FIP recipients are required to sign a Family Investment Agreement (FIA) which is a contract outlining the recipients plans to participate in education, job search, and employment activities and the states plans to provide support services and a date by which the family intends to leave FIP.
Social/Support Services: Transitional Child Care is extended from 12 to 24 months and to FIP participants with earnings who either leave FIP voluntarily or are terminated because of child support receipt.
Time Limits: FIP participants are eligible for five years total benefit receipt.
|
Outcomes Assessed
Attitudes towards work, welfare, and program
- Attitudes towards work, welfare, and program - misc.
Types of Studies
| Type |
Implementation/Process Study
|
| Aim |
To emphasize the processes by which Iowa planned for and created new policies in response to the TANF requirements and how these new policies are being integrated into the states existing welfare reform program (FIP).
To describe the learning that occurs in the course of implementation and how the state adjusts its policies in response to that learning.
To provide Iowa with valuable feedback on program strengths and weaknesses and the effects of implementation of welfare clients, as the state continues to develop and refine its FIP program to meet TANF requirements.
To provide other state and ACF with insights into policy options, potential problems, and possible solutions in TANF implementation.
|
| |
| Type |
Impact Study (Controlled Experiment)
|
| Aim |
To investigate the net impacts of welfare reform, that is the effects of welfare reform after holding other factors that could influence these outcomes (such as economic conditions) constant.
|
| |
| Type |
Descriptive/Analytical Study
|
| Aim |
To describe the standard and enhanced post-employment services provided by PROMISE JOBS, document progress toward self-sufficiency by clients who have access to the enhanced level of post-employment services and clients who do not, and welfare participation patterns across these two groups of clients.
|
| |
| Type |
Cost-Benefit Study
|
| Aim |
To provide a framework for comparing the various benefits and costs of Iowas welfare program and for determining how each is allocated.
|
| |
Data Sources
| Source |
Focus Group
|
| Title |
Welfare Reform Working Groups
|
| Sample Characteristics/Data Collection |
Individuals representing a wide range of stakeholders in the welfare reform process.
Four meetings scheduled.
|
| Sites |
Not reported.
|
| Response Rate/Attrition Notes |
N/A
|
| Additional Execution Notes |
Number and focus of working groups is evolving over time.
|
| |
| Source |
Administrative data
|
| Title |
PROMISE JOBS component file; Department of Employment Services (DES) wage records; Iowa Automated Benefit Calculation (IABC)
|
| Sample Characteristics/Data Collection |
Records collected for all members of sample.
|
| Sites |
All sites.
|
| Response Rate/Attrition Notes |
N/A
|
| Additional Execution Notes |
No notes reported.
|
| |
| Source |
Program descriptions and documents
|
| Title |
Planning documents and reports
|
| Sample Characteristics/Data Collection |
Sample includes all planning documents and reports pertaining to TANF implementation that are generated by DHS, the Advisory Group, and the Welfare Reform Working Groups (described above). Sample will also include policy memoranda issued by DHS, program manuals affected by TANF implementation, and forms and letters that DHS and PROMISE JOBS produce as part of the implementation process.
|
| Sites |
Iowa
|
| Response Rate/Attrition Notes |
N/A
|
| Additional Execution Notes |
How welfare policies are communicated to field staff and clients is also examined
|
| |
| Source |
Field Research
|
| Title |
Site visits, observations, and key-informant interviews
|
| Sample Characteristics/Data Collection |
2 site visits to each county.
Interviews conducted with supervisors and line staff in local DHS and PROMISE JOBS offices, with community services providers and welfare advocates.
Observations will include staff-client interactions during intake, orientation, and assessment, and the development of Family Investment Agreements (FIAs).
Data collection schedule not reported.
|
| Sites |
All sites.
|
| Response Rate/Attrition Notes |
N/A
|
| Additional Execution Notes |
No notes reported.
|
| |
| Source |
Interview
|
| Title |
Interview with State Administrators and Legislators
|
| Sample Characteristics/Data Collection |
State-level welfare program staff and state legislators (number in sample not reported).
Data collection schedule not reported.
|
| Sites |
Iowa
|
| Response Rate/Attrition Notes |
Not reported.
|
| Additional Execution Notes |
No notes reported.
|
| |
| Source |
Administrative data
|
| Title |
Program data
|
| Sample Characteristics/Data Collection |
3,000 FIP cases that entered first assignments to the LBP during a specified entry period, a portion of which (500) will have been assigned to a second LBP within a specified follow-up period.
Collected 2/96 - 5/97.
|
| Sites |
Iowa
|
| Response Rate/Attrition Notes |
N/A
|
| Additional Execution Notes |
No notes reported.
|
| |
| Source |
Survey
|
| Title |
Structured telephone survey of reassigned cases
|
| Sample Characteristics/Data Collection |
250 FIP cases assigned to LBP a second time.
Sampling method not reported.
Data collection schedule not reported.
|
| Sites |
Iowa
|
| Response Rate/Attrition Notes |
Expected response rate: 80%
|
| Additional Execution Notes |
No notes reported.
|
| |
| Source |
Interview
|
| Title |
Case studies with unstructured in-person interviews
|
| Sample Characteristics/Data Collection |
12 households (FIP cases)
Purposive subsample of survey sample (200 respondents).
Data collection schedule not reported.
|
| Sites |
Iowa
|
| Response Rate/Attrition Notes |
N/A
|
| Additional Execution Notes |
Case study subject will be selected from each of three distinct categories: 1) those who did not have a good understanding of program requirements; 2) those who understood requirements and tried to meet them; and 3) those who understood requirements and did not try to meet them.
|
| |
| Source |
Interview
|
| Title |
Site visits to PROMISE JOBS offices
|
| Sample Characteristics/Data Collection |
2 rounds of visits (month 10 and month 22).
First round to research counties.
Second round to pilot counties.
|
| Sites |
4 research counties (not reported)
2 pilot counties (not reported)
|
| Response Rate/Attrition Notes |
N/A
|
| Additional Execution Notes |
During visits, MPR staff will interview selected PROMISE JOBS counselors and administrators, and observe counseling sessions with clients as appropriate.
|
| |
| Source |
Administrative data
|
| Title |
Data from: IABC Master Files; JOBS component file; Iowa Workforce Development wage file
|
| Sample Characteristics/Data Collection |
Data from two sources:
1) All cases who enter PROMISE JOBS orientation between July and December, 1998.
2) Sample from post-employment study client survey.
Collected 3/00.
|
| Sites |
4 research counties (not reported)
|
| Response Rate/Attrition Notes |
N/A
|
| Additional Execution Notes |
No notes reported.
|
| |
| Source |
Survey
|
| Title |
Post-employment client survey
|
| Sample Characteristics/Data Collection |
250 cases containing an adult who went through PROMISE JOBS orientation and subsequently gained employment.
Collected months 26 and 27.
|
| Sites |
2 pilot counties and 2 comparison counties (not reported)
|
| Response Rate/Attrition Notes |
Expected response rate: 80%
|
| Additional Execution Notes |
No notes reported.
|
| |
| Source |
Interview
|
| Title |
Semi-structured interviews with case studies
|
| Sample Characteristics/Data Collection |
6 survey respondents from pilot counties and 6 survey respondents from comparison counties.
Collected month 28.
|
| Sites |
2 pilot counties and 2 comparison counties (not reported)
|
| Response Rate/Attrition Notes |
N/A
|
| Additional Execution Notes |
No notes reported.
|
| |
Findings Available
Interim Implementation Findings
Interim Impact Findings
Interim Cost-benefit Findings
Findings
|
12/01/98:
Iowa Family Investment Program (FIP) Evaluation: Two-Year Impacts
|
|
Interim Impact Findings:
There is strong evidence of increases in PROMISE JOBS participation for both applicant cases and ongoing cases, but when measured on a percentage basis, the increases are generally two to three times larger for applicants. These results confirm that welfare reform has brought about an increase in participation in employment-related activities through PROMISE JOBS(xix).
Iowas welfare reform has generated increases in both employment and earnings. Among ongoing cases, these effects were stronger during the second year of welfare reform than during the first year. In the second year, welfare reform led to 3 percent higher employment and 8 percent higher earnings among ongoing cases (although only the latter effect is statistically significant). Welfare reform had relatively large impacts on applicant cases, even in the first year following application. In that year, welfare reform increased applicant cases employment by 6 percent and their earnings by 12 percent(xix).
The positive impacts of welfare reform on employment and earnings have not been accompanied by reductions in FIP participation at least, not during the first two years of welfare reform. Follow-up analyses might reveal such an impact later in the reform period. Although FIP participation was unaffected by welfare reform during the first two years, the average FIP benefit was 4 percent lower in the second year of ongoing cases exposed to reform policies. This is consistent with our finding of higher earnings among these cases in the second year of reform (xix).
Welfare reform has led to reductions in Food Stamp participation and benefits for ongoing cases. Significant reductions were achieved in both the first and second year of reform, with larger reductions in the second year. In that year, receipt of Food Stamps by ongoing cases was down by 3 percent as a consequence of the reforms and their average Food Stamp benefit was 7 percent lower(xix).
The previously discussed increases in employment among ongoing and applicant FIP cases due to welfare reform are a consequence of reform-induced increases in employment while on welfare. Welfare reform led to relatively large increases in the percentage of ongoing an applicant cases that combine work with welfare(xxii).
Among ongoing cases, the increase in cases combining work with welfare in offset by reductions in both 1)receiving welfare but not working, and 2) working but not receiving welfare. These findings from the first two years of welfare reform indicate that the reform program encourages ongoing cases that remain on welfare to obtain jobs and discourages working cases from leaving welfare(xxii).
Among applicant cases, the increase in cases combining work with welfare is offset by a reduction in the percentage of cases that are not working. These results indicate that Iowas welfare reform is effective in encouraging applicant cases to work during their initial year following FIP application. However, they provide no evidence that the reform program indices applicants to reject welfare in favor of work during that year(xxii).
The FIP evaluation was designed to produce estimate of the impacts of the full welfare reform program in Iowa. The design is not one that will permit us to estimate with full confidence the impacts f specific components of the reform program. However, because certain identifiable segments of the FIP caseload are more likely than others to be affected by specific components or combinations of components, we can obtain empirical evidence that may be suggestive of the impacts of those components. Ongoing and applicant cases with young children were especially likely to demonstrate reform-induced increases in employment and earnings. These cases were likely to be subject to expanded PROMISE JOBS participation requirements under welfare reform(xxii).
Among all ongoing cases, the most significant impacts of welfare reform on employment and earnings were for those cases with young children but without recent earnings. Among all applicant cases, the most significant impacts on employment and earnings were for those cases with young children and with recent earnings. Cases without recent earnings were more likely to be eligible for the Work Transition Period than cases with recent earnings. Consequently, this pattern of impacts suggests, but does not prove conclusively, that the WTP, when combined with expanded PROMISE JOBS participation requirements, was more effective at promoting employment and earnings for ongoing cases than for applicant cases(xxii).
|
| |
|
02/01/99:
Iowa Family Investment Program (FIP) Evaluation: Cost-Benefit Analysis of Iowa's Family Investment Program: Two-Year Results
|
|
Interim Cost-Benefit Findings:
We found that Iowas welfare reform produced net benefits for society (for both ongoing and applicant samples) under a wide range of assumptions, even over the relatively short follow-up periods studied for this report. When viewed from the perspectives of specific subgroups, however the findings were more mixed. Ongoing FIP recipients benefited only slightly from the reforms in the first two years, while applicants benefited substantially within the first year. For ongoing cases, welfare reform produced net benefits to government as a whole and the federal government but small net costs to state and local governments. For applicant cases, welfare reform produced net costs to all branches of government in the first year, largely because of an increase in Medicaid claims paid under welfare reform(xi).
The direction of the results (whether there are net costs or savings) from the perspectives examined was largely insensitive to the specific assumptions we used. However, the size of the net costs or benefits from the various perspectives was sensitive to these assumptions. The net present value of welfare reform from the perspective of society as a whole roughly doubled as we moved from the most pessimistic to the most optimistic assumptions. From the perspective of social subgroups., the size of the net costs or benefits of welfare reform were sometimes even more sensitive to the assumptions used(xii).
|
| |
|
10/01/99:
Iowa Family Investment Program (FIP) Evaluation: Surveying Current and Former TANF Recipients in Iowa
|
|
Obtaining a response rate on the Iowa core survey of at least 70 percent, which is now the
standard for a high-quality survey of a welfare population, was very difficult. The first of two factors
that greatly contributed to the difficulty was the absence of extended contact information on sample
members at the time of random assignment. We are strong proponents of having the members of a
survey sample provide the names, addresses, and telephone numbers of several friends or relatives
on a special contact information form at baseline (the time of random assignment in an experimental
evaluation). Unfortunately, this was not possible on the FIP evaluation. Instead, we had only the
contact information that was available in DHS administrative files for the sample members
themselves. The second factor that contributed to the challenge of reaching the 70 percent response
rate threshold on the Iowa core survey was the long duration between random assignment and the
survey interview--almost six years in some cases. This meant that the limited contact information that
was available in FIP administrative files was often well out of date by the time that we attempted to
interview sampled cases.
We believe that much can be learned from the procedures that we used to conduct the Iowa core
survey that would benefit the current third generation of surveys of welfare population--the TANF
leavers surveys that are now underway--and other surveys that will follow. Indeed, we ourselves are striving to apply what we have learned on the Iowa core survey as we design and carry out a survey
of TANF leavers in Iowa that has been funded by a 1999 ASPE grant and by Iowa DHS. In addition,
we believe that the findings from our statistical analysis of the characteristics of Iowa core survey
respondents at aggregate response rates of 20,40,60,and 72 percent, as reported in Chapter IV of
this paper, are striking. They suggest that, on t e Iowa core survey, an aggregate response rate well
below 70 percent might have yielded data that would have been adequate for the research needs of
t e FIP evaluation. We encourage the states and research organizations that are now conducting
TANF leavers surveys to perform similar analyses, as any relaxation of the current 70 percent
response-rate standard should be based on consistent evidence from many surveys.
|
| |
|
11/01/99:
Iowa Family Investment Program (FIP) Evaluation: Work and Welfare: Iowa Families Tell Their Stories
|
|
Interim descriptive/analytical findings:
The report examines the effects that moving unemployed parents into jobs has had on the well-being of children, parents, and families, finding that standard work schedules usually enhance family relationships. For themes emerged from the case studies:
Employed parents with standard work schedules often spend less time, but higher quality time, with family members.
Support systems family members, colleagues, and government assistance programs make work more possible for low income families.
Employment usually improves financial well-being, but most families still have difficulty making ends meet.
Work can be physically demanding, but it is also emotionally rewarding.
|
| |
|
05/01/00:
Iowa Family Investment Program (FIP) Evaluation: Impacts During the First 3 and 1/2 Years
|
|
Interim Impact Findings:
The research findings presented in this report show that welfare reform in Iowa increased employment and average earnings during the first three and one-half years of the reform period. The findings further show that the increase in employment occurred because the reform policies encourage and allow families to work while receiving cash assistance. On the other hand, the findings provide no evidence that the reforms reduced FIP participation. However, there is evidence of small reform-induced reductions in the average FIP benefit beginning late in the second year of the reform period.
|
| |
|
07/13/01:
Iowa Family Investment Program Evaluation: Work, Welfare, and Family Well-Being
|
|
Interim Impact Findings:
- Parents were able to find entry-level jobs, but many had considerable difficulty retaining
employment.
- The most common challenges that interfered with parents working were child care
problems, physical health, and family issues.
- Receipt of FIP and assistance from Medicaid and Food Stamps decreased when parents
were working.
- The proportion of parents and children with no health insurance increased when parents
were working.
- Both total household income and expenses increased when parents were working but
overall, most parents experienced a higher standard of living.
- When employed, 4 out of 10 parents had higher self-esteem.
- One out of four parents felt their parenting skills improved or observed their family
getting along better when the parent was working.
- Most parents were very satisfied with the quality of their child care arrangements.
- Family routines, childrens social behavior, and childrens engagement in school did not
change in the aggregate when parents gained employment.
- When employed, parents felt more stress due to household finances than from parenting
or employment.
|
| |
|
08/01/01:
Iowa Family Investment Program Evaluation: Living on Little: Case Studies of Iowa Families with Very Low Incomes
|
|
Interim Impact Findings:
- Income sources and amounts fluctuate from month to month for
many low-income families. Yet, expenses such as rent, utilities, food,
and transportation are often substantial and do not change much. As
a result, families sometimes find themselves with large gaps between
what they have and what they need to get by.
- In order to cover monthly expenses and debt accrued over time,
families often engage in a variety of money-making and money-
saving strategies. The strategies described by the 16 participants in
this study parallel those described by low-income families in similar
studies conducted in other parts of the country (Edin and Lein 1997;
Danziger et al.2000).Some parents do odd jobs, collect cans, or pawn goods
for extra cash, and most try to save money by bargain shopping and
prioritizing bills. In addition, parents depend on family, friends, and to a
lesser extent, government and community agencies to make ends meet.
- Even after employing money-making and money-saving strategies,
almost all of the participants in this study were struggling to
some extent to make ends meet. Often, financial struggles have
implications for family well-being and family functioning.
Though the participants were hopeful about their prospects for
improving their finances and well-being, most faced issues and tough
decisions that made the task more challenging.
|
| |
|
06/01/02:
Iowa Family Investment Program: The Evaluation of Welfare Reform in Iowa
|
|
Final Impact Findings:
Participation in training and receipt of employment-related services increased by 6 to 7 percentage points.
Over the short term, employment and earnings increased. For the group on welfare when the reforms began, longer-term impacts on earnings were also noted for household heads, with earnings on the principal job 10 percent higher. This increase was accompanied by reductions in cash assistance and food stamp benefits, indicating greater levels of self-sufficiency.
For those who entered welfare after the reforms began, total household earnings and income at the end of the follow-up period, including earnings from all household members, decreased by about $200 a month. Participation rates in Medicaid and subsidized housing rose.
Participation in welfare increased slightly for both groups in the short run, as more generous earnings disregards made it possible for more cases to remain on assistance while employed. Welfare participation remained elevated at the end of the follow-up period for those who started receiving assistance after the reforms began.
The impact on marriage was negative for women who started receiving welfare after the reforms began and were not married when they applied for assistance. Those in the welfare reform program were 8 percent less likely than those in the traditional program to be married at follow-up, and they experienced more instability in their relationships. Researchers also noted negative impacts on some measures of family and child well-being, such as financial strain, doubling up of households, domestic abuse, and school engagement of children.
|
| |
Recommendations
|
Iowa Family Investment Program (FIP) Evaluation: Two-Year Impacts (12/01/98)
|
|
If Iowa policy makers and administrators place relatively high priority on increasing employment and earnings as opposed to reducing welfare participation, or if they are confident that the placement of welfare clients into initial jobs will result in significant employment progression over time, then it may be reasonable for them to wait and see if participation fall during the later years of welfare reform. On the other hand, if they believe that a political judgment on welfare reform will be rendered largely on the basis of its success in reducing welfare participation, or if they lack confidence that employment progression will occur naturally, then it may be advisable for them to modify the existing reforms so as to increase the likelihood of employment progression and subsequent reduction in welfare participation. Such modifications could take various forms, such as the provision of post-employment services to clients who obtain initial jobs. Those services might be designed to improve communication with supervisors and fellow workers, reduce job turnover, increase on-the-job training, or provide access to information on promotion opportunities.
|
| |
Existing Publications
|