http://www.researchforum.org/project_general_20.html

Minnesota’s Family Investment Program (MFIP) Evaluation

General Information

View a brief abstract of this project.

View a complete, printer-friendly profile of this project.

Evaluator(s) MDRC
Investigator(s) Barbara Goldman (MDRC)
Virginia Knox (MDRC)
Sponsor(s) State of Minnesota Department of Human Services
Funder(s) State of Minnesota Department of Human Services
US Department of Health and Human Services
Ford Foundation
McKnight Foundation
Northwest Area Foundation
US Department of Agriculture
Annie E. Casey Foundation
Charles Stewart Mott Foundation
Subcontractor(s) Research Triangle Institute
Wilder Research Center
 
Domain Income Security/TANF
Child/Family
Status Completed with continuing analysis
Duration Jan 1993 - Jun 2000
Type Research and/or Program Evaluation
Goal To evaluate the components of Minnesota Family Investment Program (MFIP).
Program/Policy Description MFIP attempts to encourage work, alleviate poverty, and reduce welfare dependence through financial incentives and mandatory participation in employment-focused services for long-term welfare recipients, which expands on the pre-existing voluntary STRIDE employment program.

Child Outcomes Survey: Enhanced survey developed to obtain information about MFIP's impacts on children. Target measures include child care, education, health and safety, and social and emotional adjustment.

Notes Includes enhanced child outcomes survey as part of the Project on State-Level Child Outcomes: Enhancing Measurement of Child Outcomes in State Welfare Evaluations and Other State Data Collections.
 
Last Updated 08/03/05
Type of Summary Reviewed
External Reviewer(s) Virginia Knox (MDRC)
Contact(s) Virginia Knox (virginia_knox@mdrc.org)
MDRC
16 East 34th Street
19th Floor
(T) (212)-532-3200
(F) (212)-684-0832
Publications Department MDRC Publications (publications@mdrc.org)
MDRC
16 East 34th Street
19th Floor
(T) (212) 532-3200
(F) (212) 684-0832

Populations Studied

Target Population Recipients/participants/clients
Applicants
Children
Subgroups Analyzed Single parent families
Two-parent families
Rural Populations
Sample Size and Unit 14,369 welfare applicants and clients (families).

Random sample of 7,208 experimental group (MFIP or MFIP/STRIDE) and 7,431 control group (AFDC/STRIDE or AFDC) members.

Note: A four group design for single-parents was used in Hennepin county; a three group design for single parents was used in Anoka and Dakota; a 2 group design was used for two-parent families in both urban and rural areas; and a 2 group design for non-public assistance Food Stamp families was used in rural areas only.

Sites Studied

Hennepin County (Minneapolis), Minnesota
Anoka County, Minnesota
Dakota County, Minnesota
Mille Lacs County, Minnesota
Morrison County, Minnesota
Sherburne County, Minnesota
Todd County, Minnesota
Ramsey County (St. Paul), Minnesota

Program Components, Policies, and Activities Evaluated

Employment activities

  • Job skills training
  • Job readiness activities
  • Job search

Educational activities

  • Adult Basic Education (ABE) courses
  • English as a Second Language (ESL)
  • GED courses
  • High school completion
  • Post-secondary education

Financial incentives

  • Earnings disregards
  • Elimination of 100 hour rule
  • Coverage for work-related expenses
  • Increased asset limit
  • Financial Incentives - misc.
  • Higher base grant

Financial disincentives/Sanctions

  • Reduced benefits for non-compliance

Food stamps

  • Cash out
  • Simplified program

Social/Support services

  • Child care
  • Case management

Administration/Implementation

  • Changes in welfare office environment/culture
  • Simplification of program rules and procedures

Eligibility

  • Eligibility - misc.
Variation in program components across sites? Yes
Notes on program components Changes in eligibility: Changes in program eligibility are studied. Educational activities: GED courses, ABE courses, ESL courses, high school completion, and post-secondary education are offered. Employment activities: Mandatory intensive employment and training services after single-parent families have received assistance for 24 of the last 36 months and for two-parent families after they have received assistance for 6 of the last 12 months. Financial disincentives/sanctions: Participants' benefits are reduced if program requirements are not met. Financial incentives: MFIP includes a disregard of 38% of gross earned outcome, after raising basic grant 20% if employed. MFIP allows families to receive supplemental benefits while they work until their income reaches 140% above the poverty level. The 100 hour rule is eliminated and recipients receive an increased asset limit. Work-related expenses are covered. Food stamps: Recipients receive Food Stamp benefits as part of the cash public assistance grant, instead of separately as coupons. Program operations: MFIP combines AFDC, Family General Assistance, and Food Stamps. Additionally, two-parent families no longer face multiple work history requirements and work effort limitations. Social/Support services:Clients are assigned to mandatory case management if they have received assistance for 24 of the last 36 months (single-parent families) or 6 of the last 12 months (two-parent families). Child care is provided. Case management in Ramsey county places stronger emphasis on immediate employment and becomes mandatory for single parents after 12 months of receiving assistance.

Outcomes Assessed

Education

  • High school graduation/GED receipt
  • School attendance
  • Education - misc.

Employment

  • Job attainment
  • Job retention
  • Number of hours worked for wages

Family and relationship outcomes

  • Births/pregnancies
  • Parent-child interactions
  • Family formation and stability/Living arrangements
  • Foster care

Income security

  • Child support payments
  • Earnings
  • Food stamps receipt
  • Medicaid receipt
  • Welfare receipt
  • Unemployment Insurance (UI) receipt

Adult outcomes

  • Emotional well-being
  • Adult outcomes - misc.

Housing

  • Residential mobility

Attitudes towards work, welfare, and program

  • Attitudes towards work, welfare, and program - misc.

Standard of living

  • Standard of living - misc.

Service utilization

  • Service utilization - misc.

Sanctions

  • Sanctions - misc.

Program implementation

  • Program Implementation - misc.

Emotional well-being

  • Emotional well-being - misc.

Health/ physical well-being (including prenatal health)

  • Health/ physical well-being - misc.

Financial costs and benefits/cost-effectiveness

  • Financial costs and benefits/cost-effectiveness - misc.

Child Outcomes

  • Child social/emotional/behavioral outcomes
  • Child cognitive (attention, problem solving, memory, language, and vocabulary) outcomes
  • Child academic outcomes
  • Child overall development
  • Child mental/physical health outcomes

Types of Studies

Type Impact Study (Controlled Experiment)
Aim To determine how the full MFIP program and the traditional full AFDC program differ. To determine the impact of MFIP’s mandatory employment and training when added to the identical MFIP financial incentives (full MFIP compared to MFIP using voluntary STRIDE employment program). To determine the impact of MFIP’s financial incentives when added to the voluntary STRIDE services (MFIP using voluntary STRIDE employment program compared to traditional AFDC using voluntary STRIDE employment program). To determine the impact of voluntary STRIDE services when added to the identical AFDC financial incentives (AFDC using voluntary STRIDE employment program compared with traditional AFDC with no services).
 
Type Implementation/Process Study
Aim To yield lessons regarding the feasibility of replicating the program elsewhere and explain the factors that contribute to the program’s impacts. To measure the dimensions of financial incentives and case management that may be correlated with the program’s impacts.
 
Type Cost-Benefit Study
Aim To assess the program’s benefits and costs from four perspectives: social, taxpayers’, budgetary, and recipients’. The cost portion of the analysis will estimate the program’s average gross cost per person in each of the program groups and also its average net cost. The benefits of the program will be drawn from the analysis of the program’s impacts.
 
Type Descriptive/Analytical Study
Aim Enhanced survey developed to obtain information about MFIP’s impacts on children. Focus on sample members with a child between ages 5 and 12 at the time of interview. Projected sample of 4,462 completions, including a sample with non-focal-aged children. Target measures: child care, education, health and safety, social and emotional adjustment.
 

Data Sources

Source Administrative data
Title AFDC, Food Stamp Family General Assistance, MFIP benefits, and Unemployment Insurance (UI) earnings records
Sample Characteristics/Data Collection Records for 14,369 welfare applicants and clients (in program and control groups).
Collected quarterly after random assignment.
Sites All sites.
Response Rate/Attrition Notes N/A
Additional Execution Notes No notes reported.
 
Source Survey
Title Self-administered Baseline Information Form (BIF)
Sample Characteristics/Data Collection 14,639 welfare applicant and clients.
All program and group members sampled.
Collected at baseline.
Sites Hennepin County (Minneapolis), Minnesota
Anoka County, Minnesota
Dakota County, Minnesota
Mille Lacs County, Minnesota
Morrison County, Minnesota
Sherburne County, Minnesota
Todd County, Minnesota
Response Rate/Attrition Notes N/A
Additional Execution Notes No notes reported.
 
Source Survey
Title Self-administered Personal Opinion Survey (POS)
Sample Characteristics/Data Collection 14,639 welfare applicant and clients.
All program and group members sampled.
Collected at baseline.
Sites Hennepin County (Minneapolis), Minnesota
Anoka County, Minnesota
Dakota County, Minnesota
Mille Lacs County, Minnesota
Morrison County, Minnesota
Sherburne County, Minnesota
Todd County, Minnesota
Response Rate/Attrition Notes N/A
Additional Execution Notes No notes reported.
 
Source Survey
Title In-person and telephone first client survey
Sample Characteristics/Data Collection 1,342 welfare recipients and clients (urban sample members assigned from 9/94 - 12/94).
Random sample of all program and control group members.
Collected 12 months after random assignment.
Sites Hennepin County (Minneapolis), Minnesota
Anoka County, Minnesota
Dakota County, Minnesota
Response Rate/Attrition Notes Reported response rate: 83.6%
Additional Execution Notes Additional survey conducted in Ramsey County (St. Paul), Minnesota.
 
Source Survey
Title In-person and telephone 36-month client survey
Sample Characteristics/Data Collection 4,000 welfare applicants and clients (urban and rural families).
Random sample of all program and control group members.
Collected three years after random assignment.
Sites Hennepin County (Minneapolis), Minnesota
Anoka County, Minnesota
Dakota County, Minnesota
Mille Lacs County, Minnesota
Morrison County, Minnesota
Sherburne County, Minnesota
Todd County, Minnesota
Response Rate/Attrition Notes Reported response rate: 80%
Additional Execution Notes No notes reported.
 
Source Survey
Title Staff attitude and time survey
Sample Characteristics/Data Collection Subset of all AFDC financial workers and MFIP financial workers (number in sample not reported).
Collected 9/95.
Sites Hennepin County (Minneapolis), Minnesota
Anoka County, Minnesota
Dakota County, Minnesota
Mille Lacs County, Minnesota
Morrison County, Minnesota
Sherburne County, Minnesota
Todd County, Minnesota
Response Rate/Attrition Notes Response rate not reported.
Additional Execution Notes No notes reported.
 
Source Survey
Title Self-administered staff attitude survey
Sample Characteristics/Data Collection All MFIP and STRIDE case managers (number in sample not reported).
Collected 11/95.
Sites Hennepin County (Minneapolis), Minnesota
Anoka County, Minnesota
Dakota County, Minnesota
Mille Lacs County, Minnesota
Morrison County, Minnesota
Sherburne County, Minnesota
Todd County, Minnesota
Response Rate/Attrition Notes Response rate not reported.
Additional Execution Notes No notes reported.
 
Source Survey
Title Self-administered staff time survey
Sample Characteristics/Data Collection All employment and training case managers (number in sample not reported).
Collected 11/96.
Sites Hennepin County (Minneapolis), Minnesota
Anoka County, Minnesota
Dakota County, Minnesota
Mille Lacs County, Minnesota
Morrison County, Minnesota
Sherburne County, Minnesota
Todd County, Minnesota
Response Rate/Attrition Notes Response rate not yet estimated.
Additional Execution Notes No notes reported.
 
Source Field Research
Title Key informant interview, observations, and site visits
Sample Characteristics/Data Collection Several rounds of field research from 1994-1998.
Sites All sites.
Response Rate/Attrition Notes N/A
Additional Execution Notes No notes reported.
 
Source Survey
Title Child outcomes survey
Sample Characteristics/Data Collection All children of participant and control group members (number in sample not reported).
Collected 36 months after random assignment.
Sites Hennepin County (Minneapolis), Minnesota
Anoka County, Minnesota
Dakota County, Minnesota
Mille Lacs County, Minnesota
Morrison County, Minnesota
Sherburne County, Minnesota
Todd County, Minnesota
Response Rate/Attrition Notes Reported response rate: 80%
Additional Execution Notes Sub-study includes target children, ages 5-12.
 

Findings Available

Interim Implementation Findings
Interim Impact Findings
Final Impact Findings

Findings

10/01/97: Minnesota’s Family Investment Program Evaluation: Making Welfare Work and Work Pay: Implementation and 18-Month Impacts of the Minnesota Family Investment Program
Interim Implementation Findings:

“The findings — based on field observations and interviews, staff surveys, surveys of families in MFIP and AFDC, and administrative records data — indicate that MFIP was implemented as intended and produced important changes in the way benefits and services are provided to new welfare applicants (those applying for welfare when they entered the study) and recipients (those already receiving welfare when they entered the study). In addition, after 18 months MFIP did meet its goals for single parents living in urban areas who were long-term welfare recipients when they entered the program. These individuals, who were receiving welfare for at least 24 of the prior 36 months when they entered the study, represent the most disadvantaged segment of the welfare caseload and one that has traditionally been hard to help”(3).

Interim Impact Findings

“For these long-term recipients, MFIP’s combination of financial incentives and mandatory services substantially increased employment and earnings; 18 months after random assignment, the proportion of recipients in the MFIP program who were employed was nearly 40 percent higher than among recipients in the AFDC program. In addition, the financial incentives allowed working families to supplement their earnings with partial welfare grants. The net result over the 18-month period was a 13 percent increase in total family income and a 16 percent reduction in poverty among these families, although it came at the cost of an 8 percent increase in welfare payments”(3).

“MFIP was not as successful for single parents in urban areas who were applying for welfare when they entered the program (applicants). Because participation in MFIP’s employment services is mandatory only for people who have received welfare for two or more years, these new applicants received only MFIP’s financial incentives for their first 18 months in the program. The financial incentives had only a modest effect on their employment behavior, with no significant effect by the end of follow-up, most likely because many of them would have worked anyway. Furthermore, MFIP increased welfare payments by 27 percent, primarily because the enhanced incentives enabled families to continue to receive benefits while working. When families were allowed to combine work with some welfare benefits, their total income increased by nearly 7 percent and the incidence of poverty declined by more than 6 percent”(3).

“MFIP was also not as successful among long-term welfare recipients in rural areas. It had no lasting effects on their employment or earnings — although it increased welfare receipt because, again, families were allowed to combine welfare and work, and the increase in benefits substantially reduced poverty”(3).

“To date, the results suggest that the increases in income and reductions in poverty come, in large part, from MFIP’s financial incentives. Adding a mandate to participate in employment-focused activities along with a reinforced "it pays to work" message is primarily responsible for generating the employment and earnings gains. Thus, it is the combination of these two policies that achieves the multiple goals of increased employment and earnings and reduced poverty for long-term recipients”(3).

 
11/01/95: Minnesota’s Family Investment Program Evaluation: An Early Report on Minnesota's Approach to Welfare Reform
Interim Implementation Findings: "Within the short (one-year) period of time in which program operations were studied for this report, the key components of MFIP were successfully implemented"(5). "MFIP appears to be changing the mission of the welfare office to include helping recipients make the transition for welfare to work"(5). "Field observations suggest that welfare staff and employment and training providers are implementing MFIP’s participation requirement for long-term recipients"(5). "MFIP’s employment and training services appear to be more sharply focused on early employment than those provided through STRIDE"(6). "The two main components of MFIP -financial incentives and mandatory employment-oriented services -appear to reinforce each other"(6). "Several positive factors in Minnesota have facilitated successful implementation of the program: a strong economy, the level of resources allocated to MFIP by the state, and the program’s strong political and community support"(6). Interim Impact Findings: "Six months after entering the program, single-parent recipients in the MFIP group were substantially more likely than recipients in the AFDC group to be either not on welfare or combining welfare with some reported earnings"(7). "MFIP did not increase the proportion of single-parent applicants who were either not on welfare or combining welfare with work six months after entering the program"(10). "MFIP did not increase the likelihood that two-parent families were either not on welfare or combining work and welfare six months after entering the program"(11). "On average, members of the MFIP group received higher welfare payments than their counterparts in the AFDC group"(11).
 
09/01/00: Minnesota Family Investment Program (MFIP) Evaluation: Reforming Welfare and Rewarding Work: A Summary of the Final Report on the Minnesota Family Investment Program
Final Impact Findings:

For single-parent long-term recipients — a major focus of the program and the evaluation — MFIP had strikingly consistent positive effects across a range of adult, child, and family outcomes. It also led to some increase in welfare receipt and welfare costs.

For two-parent recipient families, MFIP reduced the financial pressure for both parents to work and increased marital stability.

MFIP had more mixed effects — generally positive but smaller — on single-parent recent applicants than on single-parent long-term recipients.

For welfare applicants in two-parent families, MFIP had similar effects on employment and earnings as for recipients in two-parent families. However, MFIP did not increase family income for these applicants, who typically leave welfare quickly and were less likely to be significantly affected by the program.

Because MFIP increased support for working families — through financial incentives and, for two-parent families, less restrictive eligibility rules — the program cost between $1,900 and $3,800 more per family per year than did the AFDC system.

 
10/01/03: Minnesota's Family Investment Program: The Long Term Effects of the Minnesota Family Investment Program on Marriage and Divorce Among Two-Parent Families
Interim Descriptive/Analytical Findings:
  • MFIP decreased divorce by 3.5 percentage points, or by about 25 percent, seven years after study entry. Effects on divorce primarily occurred late in the follow-up period, even after June 1998, when the MFIP pilot study ended and a statewide MFIP evaluation was implemented.
  • For two parent recipients who were married at study entry, MFIP increased marriage stability by decreasing divorce.
  • Among cohabitating couples-- coupled parents who shared a biological child at study entry -- the cumulative rate of ever marrying during the seven-year follow-up period was similar for the MFIP and AFDC (control) groups.
  • However, MFIP cohabitating couples were 66% less likely than AFDC couples to get divorced in the follow-up period.
  • MFIP's effects on marriage stability were most pronounced among black recipient families, reducing rates of divorce among black married couples by over 70%.
Among two parent family applicants:
  • Within the AFDC (control group), two parent family applicants were more likely to divorce and less likely to marry than two parent recipient families.
  • MFIP had no cumulative effect on divorce among two parent applicant families, but did somewhat increase divorce late in the follow up period.
 
08/01/05: Minnesota's Family Investment Program Evaluation: Turning Welfare into a Work Support: Six-Year Impacts on Parents & Children from the MFIP
Impact Findings
  • For the full sample of single-parent families, MFIP increased employment, earnings, welfare receipt, and income up through Year 4 of the follow-up period, after which MFIP’s effects on economic outcomes dissipated. In two-parent families, through Year 4 of the follow-up period, MFIP reduced employment among second earners, usually women; however, the reduction in family earnings was offset by higher welfare benefits, resulting in no effects on family income.
  • MFIP’s economic effects persisted up until Year 6 for several of the most disadvantaged groups of single parents, including those with little employment history, long-term welfare receipt, and no high school diploma or General Educational Development (GED) certificate and those with a combination of these characteristics.
  • Among the full sample of single-parent families, MFIP had no overall effect on the elementary school achievement of very young children, but, in line with results for parents, positive effects did occur for several subgroups of young children for whom data are available — notably children of long-term recipients and of the most disadvantaged families. The program had no effect on elementary school achievement of young children in two-parent families.
  • By Year 6, marriage rates were similar for MFIP and AFDC single-parent families overall, but the small positive effect MFIP had at the three year point did persist for some subgroups of single-parent families. For two-parent families, MFIP’s effects on divorce varied by the prior welfare history of the two-parent family, with small reductions occurring among recipient families and an opposite pattern occurring among newer applicants, leading to no overall effect.
 

Recommendations

Minnesota’s Family Investment Program Evaluation: Making Welfare Work and Work Pay: Implementation and 18-Month Impacts of the Minnesota Family Investment Program (10/01/97)
"It was MFIP’s combination of financial incentives and mandated activities that produced the increases in employment and earnings and the reduction in poverty for long-term urban recipients. Offering either component alone would not have achieved gains of this magnitude in both areas simultaneously"(ES-17). "MFIP’s success with long-term recipients is particularly noteworthy. Conversely, the absence of a sustained increase in employment or earnings among applicants suggests the program might need to be structured differently for them"(ES-18). "The implementation evidence suggests that the financial incentives were instrumental in shaping the employment focus of the mandated activities and services"(ES-18). "In the short term, MFIP recipients stayed on welfare longer than their AFDC counterparts because they were able to combine welfare and work. It is unclear whether, over the long term, recipients will extend their work hours and go off welfare completely. This result has implications for imposing time limits on welfare receipt"(ES-18). "Financial incentives may help change the culture of welfare office and of welfare employment and training programs"(ES-19).
 

Existing Publications

11/01/95 Minnesota’s Family Investment Program Evaluation: An Early Report on Minnesota's Approach to Welfare Reform MDRC
01/01/97 Minnesota's Family Investment Program Evaluation: A Proposal to Continue the Evaluation of the Minnesota Family Investment Program (MFIP) MDRC
10/01/97 Minnesota’s Family Investment Program Evaluation: Making Welfare Work and Work Pay: Implementation and 18-Month Impacts of the Minnesota Family Investment Program MDRC
11/01/98 Minnesota's Family Investment Program Evaluation: Impact Update MDRC
01/01/98 Minnesota's Family Investment Program Evaluation: Project on State-Level Child Outcomes Child Trends
09/01/00 Minnesota Family Investment Program (MFIP) Evaluation: Reforming Welfare and Rewarding Work: A Summary of the Final Report on the Minnesota Family Investment Program MDRC
09/01/00 Minnesota Family Investment Program (MFIP) Evaluation: Reforming Welfare and Rewarding Work: Final Report: Volume 1: Effects on Adults MDRC
09/01/00 Minnesota Family Investment Program (MFIP) Evaluation: Reforming Welfare and Rewarding Work: Final Report: Volume 2: Effects on Children MDRC
09/01/00 Minnesota Family Investment Program (MFIP) Evaluation: Rural-Urban Differences in the Minnesota Family Investment Program JCPR
09/01/00 Minnesota Family Investment Program: Final Report on the Implementation and Impacts in Ramsey County MDRC
10/01/03 Minnesota's Family Investment Program: The Long Term Effects of the Minnesota Family Investment Program on Marriage and Divorce Among Two-Parent Families MDRC
08/01/05 Minnesota's Family Investment Program Evaluation: Turning Welfare into a Work Support: Six-Year Impacts on Parents & Children from the MFIP MDRC