|
North Dakota Training, Education, Employment, and Management (TEEM) Project Evaluation
General Information
View a brief abstract of this project.
View a complete, printer-friendly profile of this project.
| Evaluator(s) |
Berkeley Policy Associates
|
| Investigator(s) |
Rebecca London
(Berkeley Policy Associates)
Stephen Walsh
(Berkeley Policy Associates)
|
| Sponsor(s) |
North Dakota Department of Human Services
|
| Funder(s) |
US Department of Health and Human Services, Administration for Children and Families
US Department of Health and Human Services
|
| Subcontractor(s) |
Not applicable
|
| |
| Domain |
Income Security/TANF
|
| Status |
Completed (final report released)
|
| Duration |
May 1997 - Mar 2000
|
| Type |
Research and/or Program Evaluation
|
| Goal |
To evaluate North Dakotas Training, Education, Employment and Management (TEEM) Project.
|
| Program/Policy Description |
North Dakotas Training, Education, Employment and Management (TEEM) Project was developed in 1997 to promote self-sufficiency for individuals who cannot find employment, even in the best economic conditions, by assessing individuals barriers to employment and assisting them in overcoming these barriers. TEEM includes the following components: assessment, referral, and social contract; work incentives; sanctions; raised asset levels; and incentives for family stability. In addition, North Dakota has a family cap (the AFDC-UP program serving married eligible couples, was eliminated in 1997).
|
| Notes |
No notes reported.
|
| |
| Last Updated |
12/14/01
|
| Type of Summary |
Reviewed
|
| External Reviewer(s) |
Rebecca London
(Berkeley Policy Associates)
|
| Contact(s) |
John Hougen (not reported)
North Dakota Department of Human Services
600 E. Boulevard
(T) (701)-328-1715
(F) (701) 328-1544
|
| Publications Department |
No publications dept. (info@bpacal.com)
Berkeley Policy Associates
440 Grand Avenue
Suite 500
(T) (510) 465-7884
(F) (510) 465-7885
|
Populations Studied
| Target Population |
Recipients/participants/clients
|
| Subgroups Analyzed |
None
|
| Sample Size and Unit |
Process analysis includes 7 representative counties.
Quantitative analysis includes all recipients in the state (caseload in the state is about 5,000).
|
Sites Studied
North Dakota
Program Components, Policies, and Activities Evaluated
Employment activities
- Job readiness activities
- Job search
- Job placement
Financial incentives
- Earnings disregards
- Excluding the value of one vehicle
- Increased asset limit
- Tax reduction/rebate (e.g. Earned Income Tax Credit)
- Transitional income benefits
- Financial Incentives - misc.
Financial disincentives/Sanctions
- Reduced benefits for non-compliance
Program requirements
- Community or alternative work
- Parenting or social contract
- School attendance
- Living arrangements for unwed pregnant or parenting minors
- Immunizations for children
- Broadened JOBS participation requirement
Social/Support services
- Child care
- Transitional child care
- Health benefits
- Transportation
- Case management
- Parenting classes/training
- Counseling
- Substance abuse/dependence treatment
- Social/Support Services - misc.
Administration/Implementation
- Changes in welfare office environment/culture
- Simplification of program rules and procedures
- Program enforcement of sanctions
- Development of new welfare policies
Time limits
Family caps
Eligibility
| Variation in program components across sites? |
Yes
|
| Notes on program components |
Changes in eligibility: Eligibility rules are made consistent to reduce the burden on both recipients and administration.
Family caps: TANF recipients who have children while receiving benefits will not be eligible for additional benefits.
Financial disincentives/sanctions: Work effort is promoted through sanctions for failure to comply with the social contract. Sanctions are cumulative so that recipients who repeatedly fail to comply are penalized in a sequentially more punitive manner.
Financial incentives: Increased work effort is encourages through increasing the earning disregard and increasing the dependent care and health insurance deductions. Asset limits are raised to $8,000 per family or $5,000 per individual and one vehicle per household is exempted to allow individuals to accrue savings and equity.
Program operations/implementation: Implementation of program across counties and sub-groups is examined. Recipients undergo a screening using the TEEM expert system, a computerized system designed to help case managers and recipients identify barriers they may have to employment. If necessary, referrals are made to counseling services, childcare services, drug or alcohol treatment, financial management services, or a variety of other services that individuals may need.
Program requirements: After assessment and/or referral, recipients are required to sign a Social Contract with specific goals and a timeline tracking their path to independence.
Social/Support services: Transitional support services are provided for individuals who leave the welfare system through employment.
Time limits: Recipients are limited to 5 years of lifetime benefit receipt.
|
Outcomes Assessed
Benefit termination
- Due to employment
- Due to sanctions
Education
Employment
Income security
Family and relationship outcomes
- Family formation and stability/Living arrangements
Attitudes towards work, welfare, and program
- Attitudes towards work, welfare, and program - misc.
Service utilization
- Service utilization - misc.
Sanctions
Program implementation
- Program Implementation - misc.
Policy changes
Child Outcomes
- Child overall development
Types of Studies
| Type |
Implementation/Process Study
|
| Aim |
To determine how the policies, services, and program rules in place under the new TEEM and TANF provisions are implemented and operated in North Dakota.
To document the implementation and assess the performance of the TEEM screening system, a computer-based expert system designed to promote self-sufficiency by identifying recipients barriers to work.
To examine the implementation of a diverse set of reforms aimed at promoting employment, including both positive and negative interventions (i.e. work incentives as well as sanctions).
To describe the implementation and responses to a family cap, which limits benefit amounts for recipients who have additional children while receiving benefits.
To document variation in the implementation and operation of welfare at local (county and tribal) levels, and to identify the sources of variation.
|
| |
| Type |
Descriptive/Analytical Study
|
| Aim |
To determine how the new policies and programs affect families and county welfare office staff, and if this varies by sub-population (i.e. ethnicity) and county.
To study post-program outcomes, tracking recidivism through the TEEM system and employment and earnings through UI wage records, for the 21-month study period.
|
| |
Data Sources
| Source |
Field Research
|
| Title |
Planning Interviews
|
| Sample Characteristics/Data Collection |
Administrators who participated in the early design and planning of waiver application and project implementation.
Collected early in evaluation.
|
| Sites |
North Dakota DHS
|
| Response Rate/Attrition Notes |
N/A
|
| Additional Execution Notes |
No notes reported.
|
| |
| Source |
Field Research
|
| Title |
Site visits and observations
|
| Sample Characteristics/Data Collection |
Sample of 4 demonstration counties and 3 non-demonstration counties.
Stratified random sample based on caseload size, demonstration status, Native American presence and geographic location.
Collected months 2,8, 20 (demonstration counties); months 14,20 (non-demonstration counties).
|
| Sites |
Demonstration counties:
Cass County, North Dakota
Stark County, North Dakota
Richland County, North Dakota
Stark County, North Dakota
Non-demonstration counties:
Rollette County, North Dakota
Burleigh County, North Dakota
Walsh County, North Dakota
|
| Response Rate/Attrition Notes |
N/A
|
| Additional Execution Notes |
Each site visit lasts 3 days.
Respondents include program administrators, caseworkers, agencies to which clients are referred, client focus groups, and other key program staff identified by the site.
|
| |
| Source |
Focus Group
|
| Title |
Client focus groups
|
| Sample Characteristics/Data Collection |
8-10 clients in each focus group (two to three per visit).
Collected months 2,8,20 (demonstration counties); months 14,20 (non-demonstration counties).
|
| Sites |
Demonstration counties:
Cass County, North Dakota
Stark County, North Dakota
Richland County, North Dakota
Stark County, North Dakota
Non-demonstration counties:
Rollette County, North Dakota
Burleigh County, North Dakota
Walsh County, North Dakota
|
| Response Rate/Attrition Notes |
N/A
|
| Additional Execution Notes |
Each focus group lasts 60-90 minutes.
|
| |
| Source |
Administrative data
|
| Title |
TEEM system records, TECS system records (data form the old AFDC system), and county-level information coded from the Field Study
|
| Sample Characteristics/Data Collection |
Caseload is approximately 5,000.
Data collection schedule not reported.
|
| Sites |
All counties in North Dakota
|
| Response Rate/Attrition Notes |
N/A
|
| Additional Execution Notes |
Descriptive analysis of components utilized, duration of receipt, and reasons for case closure studied.
|
| |
Findings Available
Final Descriptive/Analytical Findings
Findings
|
05/01/00:
North Dakota Training, Education, Employment, and Management (TEEM): Final Report
|
|
Final Descriptive/Analytical Findings:
- After Teem eligibility ends, families have substantial public assistance support available through other public assistance programs.
- The Earned Income Tax Credit provides substantial cash payments to low-income families who file taxes.
- Teem components have been fully implemented.
- Teem managers' need ongoing training to fulfill their case management role.
- Teem managers are often not the client's primary case manager.
- The assessment process could be improved.
- Teem Adult Included Cases are becoming increasingly comprised of Native Americans.
- Over time, children in adult not included cases were more likely to be living with parents receiving disability payments.
- More Teem recipients were engaged in work activities over time.
- On average, adult included cases spent 12 of the 21 months we observed on aid
- One-fifth of case closures were due to employment.
- Statewide recidivism was on par with or slightly higher than in other states.
|
| |
Recommendations
|
North Dakota Training, Education, Employment, and Management (TEEM): Final Report (05/01/00)
|
|
We recommend that DHS ensures that TEEM managers are knowledgeable about and inform recipients about their post-TEEM eligibility for various social programs, including the Earned Income Tax Credit.
We recommend that DHS develop a plan for ongoing staff development, and provide further training on case management to TEEM managers in all counties.
There is overlap in case management responsibilities between the JOBS provider and TEEM manager. We recommend DHS shorten the time between TEEM intake and assessment, consider ways to link JOBS and TEEM assessments, and improve information-sharing between the two programs.
The assessment should be more flexible to accommodate clients' individual needs, strengths, and interests. A more flexible screening tool would be most useful for re-assessment purposes.
JOBS activities should be expanded to include job retention services.
DHS should make an effort to involve employers in welfare to work efforts.
DHS should provide information to the counties regarding state time limit policy guidelines in an appropriate time frame.
DHS should work with Tribal leaders to help Native American TEEM recipients meet their self-sufficiency goals.
DHS should ensure that TEEM clients, TEEM managers, and JOBS coordinators are all aware of clients' time left on aid.
|
| |
Existing Publications
|