http://www.researchforum.org/project_general_72.html

North Dakota Training, Education, Employment, and Management (TEEM) Project Evaluation

General Information

View a brief abstract of this project.

View a complete, printer-friendly profile of this project.

Evaluator(s) Berkeley Policy Associates
Investigator(s) Rebecca London (Berkeley Policy Associates)
Stephen Walsh (Berkeley Policy Associates)
Sponsor(s) North Dakota Department of Human Services
Funder(s) US Department of Health and Human Services, Administration for Children and Families
US Department of Health and Human Services
Subcontractor(s) Not applicable
 
Domain Income Security/TANF
Status Completed (final report released)
Duration May 1997 - Mar 2000
Type Research and/or Program Evaluation
Goal To evaluate North Dakota’s Training, Education, Employment and Management (TEEM) Project.
Program/Policy Description North Dakota’s Training, Education, Employment and Management (TEEM) Project was developed in 1997 to promote self-sufficiency for individuals who cannot find employment, even in the best economic conditions, by assessing individuals’ barriers to employment and assisting them in overcoming these barriers. TEEM includes the following components: assessment, referral, and social contract; work incentives; sanctions; raised asset levels; and incentives for family stability. In addition, North Dakota has a family cap (the AFDC-UP program serving married eligible couples, was eliminated in 1997).
Notes No notes reported.
 
Last Updated 12/14/01
Type of Summary Reviewed
External Reviewer(s) Rebecca London (Berkeley Policy Associates)
Contact(s) John Hougen (not reported)
North Dakota Department of Human Services
600 E. Boulevard
(T) (701)-328-1715
(F) (701) 328-1544
Publications Department No publications dept. (info@bpacal.com)
Berkeley Policy Associates
440 Grand Avenue
Suite 500
(T) (510) 465-7884
(F) (510) 465-7885

Populations Studied

Target Population Recipients/participants/clients
Subgroups Analyzed None
Sample Size and Unit Process analysis includes 7 representative counties.
Quantitative analysis includes all recipients in the state (caseload in the state is about 5,000).

Sites Studied

North Dakota

Program Components, Policies, and Activities Evaluated

Employment activities

  • Job readiness activities
  • Job search
  • Job placement

Financial incentives

  • Earnings disregards
  • Excluding the value of one vehicle
  • Increased asset limit
  • Tax reduction/rebate (e.g. Earned Income Tax Credit)
  • Transitional income benefits
  • Financial Incentives - misc.

Financial disincentives/Sanctions

  • Reduced benefits for non-compliance

Program requirements

  • Community or alternative work
  • Parenting or social contract
  • School attendance
  • Living arrangements for unwed pregnant or parenting minors
  • Immunizations for children
  • Broadened JOBS participation requirement

Social/Support services

  • Child care
  • Transitional child care
  • Health benefits
  • Transportation
  • Case management
  • Parenting classes/training
  • Counseling
  • Substance abuse/dependence treatment
  • Social/Support Services - misc.

Administration/Implementation

  • Changes in welfare office environment/culture
  • Simplification of program rules and procedures
  • Program enforcement of sanctions
  • Development of new welfare policies

Time limits

  • Time Limits - misc.

Family caps

  • Family Caps - misc.

Eligibility

  • Eligibility - misc.
Variation in program components across sites? Yes
Notes on program components Changes in eligibility: Eligibility rules are made consistent to reduce the burden on both recipients and administration.

Family caps: TANF recipients who have children while receiving benefits will not be eligible for additional benefits.

Financial disincentives/sanctions: Work effort is promoted through sanctions for failure to comply with the social contract. Sanctions are cumulative so that recipients who repeatedly fail to comply are penalized in a sequentially more punitive manner.

Financial incentives: Increased work effort is encourages through increasing the earning disregard and increasing the dependent care and health insurance deductions. Asset limits are raised to $8,000 per family or $5,000 per individual and one vehicle per household is exempted to allow individuals to accrue savings and equity.

Program operations/implementation: Implementation of program across counties and sub-groups is examined. Recipients undergo a screening using the TEEM expert system, a computerized system designed to help case managers and recipients identify barriers they may have to employment. If necessary, referrals are made to counseling services, childcare services, drug or alcohol treatment, financial management services, or a variety of other services that individuals may need.

Program requirements: After assessment and/or referral, recipients are required to sign a Social Contract with specific goals and a timeline tracking their path to independence.

Social/Support services: Transitional support services are provided for individuals who leave the welfare system through employment.

Time limits: Recipients are limited to 5 years of lifetime benefit receipt.

Outcomes Assessed

Benefit termination

  • Due to employment
  • Due to sanctions

Education

  • School attendance

Employment

  • Job attainment

Income security

  • Earnings
  • Welfare receipt

Family and relationship outcomes

  • Family formation and stability/Living arrangements

Attitudes towards work, welfare, and program

  • Attitudes towards work, welfare, and program - misc.

Service utilization

  • Service utilization - misc.

Sanctions

  • Sanctions - misc.

Program implementation

  • Program Implementation - misc.

Policy changes

  • Policy changes-misc.

Child Outcomes

  • Child overall development

Types of Studies

Type Implementation/Process Study
Aim To determine how the policies, services, and program rules in place under the new TEEM and TANF provisions are implemented and operated in North Dakota.

To document the implementation and assess the performance of the TEEM screening system, a computer-based expert system designed to promote self-sufficiency by identifying recipients’ barriers to work.

To examine the implementation of a diverse set of reforms aimed at promoting employment, including both positive and negative interventions (i.e. work incentives as well as sanctions).

To describe the implementation and responses to a family cap, which limits benefit amounts for recipients who have additional children while receiving benefits.

To document variation in the implementation and operation of welfare at local (county and tribal) levels, and to identify the sources of variation.

 
Type Descriptive/Analytical Study
Aim To determine how the new policies and programs affect families and county welfare office staff, and if this varies by sub-population (i.e. ethnicity) and county.

To study post-program outcomes, tracking recidivism through the TEEM system and employment and earnings through UI wage records, for the 21-month study period.

 

Data Sources

Source Field Research
Title Planning Interviews
Sample Characteristics/Data Collection Administrators who participated in the early design and planning of waiver application and project implementation.
Collected early in evaluation.
Sites North Dakota DHS
Response Rate/Attrition Notes N/A
Additional Execution Notes No notes reported.
 
Source Field Research
Title Site visits and observations
Sample Characteristics/Data Collection Sample of 4 demonstration counties and 3 non-demonstration counties.
Stratified random sample based on caseload size, demonstration status, Native American presence and geographic location.
Collected months 2,8, 20 (demonstration counties); months 14,20 (non-demonstration counties).
Sites Demonstration counties:
Cass County, North Dakota
Stark County, North Dakota
Richland County, North Dakota
Stark County, North Dakota
Non-demonstration counties:
Rollette County, North Dakota
Burleigh County, North Dakota
Walsh County, North Dakota
Response Rate/Attrition Notes N/A
Additional Execution Notes Each site visit lasts 3 days. Respondents include program administrators, caseworkers, agencies to which clients are referred, client focus groups, and other key program staff identified by the site.
 
Source Focus Group
Title Client focus groups
Sample Characteristics/Data Collection 8-10 clients in each focus group (two to three per visit).
Collected months 2,8,20 (demonstration counties); months 14,20 (non-demonstration counties).
Sites Demonstration counties:
Cass County, North Dakota
Stark County, North Dakota
Richland County, North Dakota
Stark County, North Dakota
Non-demonstration counties:
Rollette County, North Dakota
Burleigh County, North Dakota
Walsh County, North Dakota
Response Rate/Attrition Notes N/A
Additional Execution Notes Each focus group lasts 60-90 minutes.
 
Source Administrative data
Title TEEM system records, TECS system records (data form the old AFDC system), and county-level information coded from the Field Study
Sample Characteristics/Data Collection Caseload is approximately 5,000.
Data collection schedule not reported.
Sites All counties in North Dakota
Response Rate/Attrition Notes N/A
Additional Execution Notes Descriptive analysis of components utilized, duration of receipt, and reasons for case closure studied.
 

Findings Available

Final Descriptive/Analytical Findings

Findings

05/01/00: North Dakota Training, Education, Employment, and Management (TEEM): Final Report
Final Descriptive/Analytical Findings:

  • After Teem eligibility ends, families have substantial public assistance support available through other public assistance programs.
  • The Earned Income Tax Credit provides substantial cash payments to low-income families who file taxes.
  • Teem components have been fully implemented.
  • Teem managers' need ongoing training to fulfill their case management role.
  • Teem managers are often not the client's primary case manager.
  • The assessment process could be improved.
  • Teem Adult Included Cases are becoming increasingly comprised of Native Americans.
  • Over time, children in adult not included cases were more likely to be living with parents receiving disability payments.
  • More Teem recipients were engaged in work activities over time.
  • On average, adult included cases spent 12 of the 21 months we observed on aid
  • One-fifth of case closures were due to employment.
  • Statewide recidivism was on par with or slightly higher than in other states.
 

Recommendations

North Dakota Training, Education, Employment, and Management (TEEM): Final Report (05/01/00)
  • We recommend that DHS ensures that TEEM managers are knowledgeable about and inform recipients about their post-TEEM eligibility for various social programs, including the Earned Income Tax Credit.
  • We recommend that DHS develop a plan for ongoing staff development, and provide further training on case management to TEEM managers in all counties.
  • There is overlap in case management responsibilities between the JOBS provider and TEEM manager. We recommend DHS shorten the time between TEEM intake and assessment, consider ways to link JOBS and TEEM assessments, and improve information-sharing between the two programs.
  • The assessment should be more flexible to accommodate clients' individual needs, strengths, and interests. A more flexible screening tool would be most useful for re-assessment purposes.
  • JOBS activities should be expanded to include job retention services.
  • DHS should make an effort to involve employers in welfare to work efforts.
  • DHS should provide information to the counties regarding state time limit policy guidelines in an appropriate time frame.
  • DHS should work with Tribal leaders to help Native American TEEM recipients meet their self-sufficiency goals.
  • DHS should ensure that TEEM clients, TEEM managers, and JOBS coordinators are all aware of clients' time left on aid.
  •  

    Existing Publications

    07/01/98 North Dakota Training, Education, Employment, and Management (TEEM): Interim Implementation Report BPA
    05/01/00 North Dakota Training, Education, Employment, and Management (TEEM): Final Report BPA
    07/01/98 North Dakota Training, Education, Employment, and Management (TEEM): Project Narrative BPA