Evaluation of Teachers Trained Through Different Routes to

Evaluation of Teachers Trained Through Different Routes to Certification Presentation at the IES Research Conference June 2009 Jill Constantine Mathematica Policy Research, Inc. Motivation Alternative certification (AC) programs supply increasing numbers of teachers Debates on whether AC programs adequately prepare teachers for the classroom The effectiveness of different training strategies has not been rigorously studied

What are AC Programs? Allow teachers to begin teaching before completing required coursework Typically require less coursework than traditional certification (TC) programs and no student teaching Have perceived advantages and disadvantages Reduce barriers to entry (positive) Produce teachers with inadequate training (negative) Previous Research Numerous rigorous studies on selective AC programs, but are mainly about TFA and NYC Teaching Fellows

Most AC programs are not highly selective with admission requirements similar to TC programs Study expands evidence on AC teachers by examining teachers from less selective programs in 7 states Research Questions 1. What are the effects on student achievement of teachers trained through different routes to certification? 2. What aspects of teacher preparation are associated with teacher effectiveness?

Amount of coursework Timing of coursework Content of coursework Study Design Research Design and Participants: Randomly assign students to novice AC or TC teacher in the same grade and school to create several miniexperiments Analysis: Compare outcomes of students randomly assigned to AC teacher to those randomly assigned to TC teacher Study design: Provides a test of the effectiveness of teachers from different preparation programs, not direct test of the programs Selecting AC Programs Focused on less-selective programs, admissions requirements similar to TC programs

Divided sample into AC programs with relatively low and high coursework requirements Geographic Distribution of Sample Teachers Districts Schools AC TC Total California 5 15 20 18

38 Illinois, Wisconsin, Louisiana, Georgia 7 12 15 16 31 New Jersey 3 9 9 9

18 Texas 5 23 43 44 87 Total 20 63 87 87 174

Grade Distribution of Sample Grade Number of Mini-Experiments Kindergarten 20 First 30 Second 14 Third 9 Fourth 11

Fifth 6 Total 90 Baseline Measures of Students AC Classrooms TC Classrooms P-Value Reading Pretest 38.71 38.03 0.38

Math Pretest 42.07 42.14 0.92 Free/Reduced Lunch Eligible 75% 78% 0.08 Male 51% 49% 0.37 Nonwhite

92% 91% 0.56 Total Students 1,276 1,334 Data Student achievement California Achievement Test, 5th edition Teacher Practices Vermont Classroom Observation Tool Principal ratings

Teacher Characteristics Teacher Survey Program Characteristics AC and TC program interviews Findings Required Coursework Hours Low AC Comparison High AC Comparison 0 100 Class management 200 300

400 Reading Pedagogy Student Assessment Child Development 500 Math Pedagogy Other 600 700 AC-TC Differences in Required Coursework Timing of Required Coursework Hours 150 150 131

Teacher Characteristics Low Coursework AC TC White 49% Black Female High Coursework p-Value AC TC p-Value 74%

.02* 41% 70% .01* 40% 20% .01* 32% 8% .01* 96% 98% .56

79% 89% .21 Age (yrs) 34 28 .00** 34 30 .01* SAT Score 930 959

.43 1,010 1,013 .95 Experience (yrs) 2.4 3.0 .06 2.7 2.8 .51 N 46

46 42 44 Experimental Results AC Classroom Average score TC Classroom Average Score Effect Size p-Value Overall 38.51

38.62 -0.01 0.84 Low Coursework 38.29 38.50 -0.01 0.81 High Coursework 38.76 38.76 0.00 1.00

Overall 41.75 42.77 -0.05 0.12 Low Coursework 41.52 42.12 -0.03 0.56 High Coursework 42.03 43.53

-0.07 0.10 Reading Math Distribution of Effects Results for Subgroups Students in California with AC teachers scored statistically lower in math than students of TC counterparts (effect size = -.13) Students of AC teachers taking coursework scored lower in math than students of TC counterparts (effect size = -.09)

No other subgroups showed statistically significant differences Teacher Practices Non-Experimental Results Differences in AC teachers' characteristics, practices, and training explained about 5 percent of math scores and 1 percent of reading scores Students of AC teachers taking coursework scored lower than TC comparisons in reading Students of AC teachers with master's degrees scored lower than TC comparisons in reading

No other differences were statistically significant Summary Students of AC teachers performed the same, on average, as students of TC teachers in their schools Variation in the amount and content of required coursework in teacher preparation was not linked to teachers' effectiveness in terms of student achievement Completing required coursework while teaching is associated with lower student achievement

Recently Viewed Presentations

  • Chemical BONDING IONIC Lewis Dot Diagrams Sodium Chloride

    Chemical BONDING IONIC Lewis Dot Diagrams Sodium Chloride

    Chemical BONDING IONIC Lewis Dot Diagrams Sodium Chloride This is the finished Lewis Dot Structure [Na]+1 [ Cl ]-1 How did we get here? Practice Dot diagrams & formulas Lithium fluoride Magnesium oxide Calcium chloride Potassium hydride Drawing molecules using...
  • Historical perspectives in Special Education:

    Historical perspectives in Special Education:

    Historical Perspectives in Special Education A brief review Ancient Views (BC) Seriously affected seldom survived birth Mildly disabled survived and contributed Belief in supernatural led to (2) different views: Demons; therefore kill them Unique; therefore revere and honor Regardless, those...
  • Acceleration Derivations - University of Nebraska Omaha

    Acceleration Derivations - University of Nebraska Omaha

    Acceleration Derivations Many of you remember the old 'DiRT' formula. Distance = Rate times Time Scientifically, it's 'average velocity' equals distance divided by time.
  • Section 2.5: Polyalphabetic Substitutions

    Section 2.5: Polyalphabetic Substitutions

    3. German Enigma cipher machine used in World War II - p. 23-25 of the Barr text. 4. Vigene re Cipher - a polyalphabetic cipher invented by the Frenchman Blaise de Vigene re Cipher in 1585. The value of this...
  • Producers, Consumers, Decomposers - Helena High School

    Producers, Consumers, Decomposers - Helena High School

    An organism is ….. Any independent living thing Can be as small as a single celled bacteria Or as large as a whale! Categories of Feeding Relationships Producers Consumers Decomposers Detritivores Scavengers They are all depend on each other. Primary...
  • Modifying Your Teaching Styles  In the Classroom and

    Modifying Your Teaching Styles In the Classroom and

    Questions to ask Parents. IEP/504: Is the individual on an IEP/504 plan at school?. Independent with ADL's: Is the individual able to dress themselves, do laundry, use the stove, cross the street independently, make a sandwich, manage money or checking...
  • Land-use effects on carbon flux in PNW forests: contributions ...

    Land-use effects on carbon flux in PNW forests: contributions ...

    Land-use Impacts on PNW Forests PNW forests are among the most productive in the world. These forests have the capacity to store significant amounts of C Timber harvest activities in this region have the capacity to have a major impact...
  • NEXT STEPS: IT Department-as-a-Service Your Digital Transformation Partner

    NEXT STEPS: IT Department-as-a-Service Your Digital Transformation Partner

    PROJEX IMC | January 2018. VIRTUAL CIO SERVICES MENU. Business Process Management is the modeling, automation, execution, control, measurement and optimization of business activity flows. There are two categories of software tools designed to optimize business processes individually, or across...