Evaluation of Teachers Trained Through Different Routes to

Evaluation of Teachers Trained Through Different Routes to Certification Presentation at the IES Research Conference June 2009 Jill Constantine Mathematica Policy Research, Inc. Motivation Alternative certification (AC) programs supply increasing numbers of teachers Debates on whether AC programs adequately prepare teachers for the classroom The effectiveness of different training strategies has not been rigorously studied

What are AC Programs? Allow teachers to begin teaching before completing required coursework Typically require less coursework than traditional certification (TC) programs and no student teaching Have perceived advantages and disadvantages Reduce barriers to entry (positive) Produce teachers with inadequate training (negative) Previous Research Numerous rigorous studies on selective AC programs, but are mainly about TFA and NYC Teaching Fellows

Most AC programs are not highly selective with admission requirements similar to TC programs Study expands evidence on AC teachers by examining teachers from less selective programs in 7 states Research Questions 1. What are the effects on student achievement of teachers trained through different routes to certification? 2. What aspects of teacher preparation are associated with teacher effectiveness?

Amount of coursework Timing of coursework Content of coursework Study Design Research Design and Participants: Randomly assign students to novice AC or TC teacher in the same grade and school to create several miniexperiments Analysis: Compare outcomes of students randomly assigned to AC teacher to those randomly assigned to TC teacher Study design: Provides a test of the effectiveness of teachers from different preparation programs, not direct test of the programs Selecting AC Programs Focused on less-selective programs, admissions requirements similar to TC programs

Divided sample into AC programs with relatively low and high coursework requirements Geographic Distribution of Sample Teachers Districts Schools AC TC Total California 5 15 20 18

38 Illinois, Wisconsin, Louisiana, Georgia 7 12 15 16 31 New Jersey 3 9 9 9

18 Texas 5 23 43 44 87 Total 20 63 87 87 174

Grade Distribution of Sample Grade Number of Mini-Experiments Kindergarten 20 First 30 Second 14 Third 9 Fourth 11

Fifth 6 Total 90 Baseline Measures of Students AC Classrooms TC Classrooms P-Value Reading Pretest 38.71 38.03 0.38

Math Pretest 42.07 42.14 0.92 Free/Reduced Lunch Eligible 75% 78% 0.08 Male 51% 49% 0.37 Nonwhite

92% 91% 0.56 Total Students 1,276 1,334 Data Student achievement California Achievement Test, 5th edition Teacher Practices Vermont Classroom Observation Tool Principal ratings

Teacher Characteristics Teacher Survey Program Characteristics AC and TC program interviews Findings Required Coursework Hours Low AC Comparison High AC Comparison 0 100 Class management 200 300

400 Reading Pedagogy Student Assessment Child Development 500 Math Pedagogy Other 600 700 AC-TC Differences in Required Coursework Timing of Required Coursework Hours 150 150 131

Teacher Characteristics Low Coursework AC TC White 49% Black Female High Coursework p-Value AC TC p-Value 74%

.02* 41% 70% .01* 40% 20% .01* 32% 8% .01* 96% 98% .56

79% 89% .21 Age (yrs) 34 28 .00** 34 30 .01* SAT Score 930 959

.43 1,010 1,013 .95 Experience (yrs) 2.4 3.0 .06 2.7 2.8 .51 N 46

46 42 44 Experimental Results AC Classroom Average score TC Classroom Average Score Effect Size p-Value Overall 38.51

38.62 -0.01 0.84 Low Coursework 38.29 38.50 -0.01 0.81 High Coursework 38.76 38.76 0.00 1.00

Overall 41.75 42.77 -0.05 0.12 Low Coursework 41.52 42.12 -0.03 0.56 High Coursework 42.03 43.53

-0.07 0.10 Reading Math Distribution of Effects Results for Subgroups Students in California with AC teachers scored statistically lower in math than students of TC counterparts (effect size = -.13) Students of AC teachers taking coursework scored lower in math than students of TC counterparts (effect size = -.09)

No other subgroups showed statistically significant differences Teacher Practices Non-Experimental Results Differences in AC teachers' characteristics, practices, and training explained about 5 percent of math scores and 1 percent of reading scores Students of AC teachers taking coursework scored lower than TC comparisons in reading Students of AC teachers with master's degrees scored lower than TC comparisons in reading

No other differences were statistically significant Summary Students of AC teachers performed the same, on average, as students of TC teachers in their schools Variation in the amount and content of required coursework in teacher preparation was not linked to teachers' effectiveness in terms of student achievement Completing required coursework while teaching is associated with lower student achievement

Recently Viewed Presentations

  • Box score: 6 /6  1 - Introduction  2

    Box score: 6 /6 1 - Introduction 2

    Deployables Checklist Withstand temperature, vibration, storage time, vacuum, radiation? Acceptable EMI, RFI, Magnetic moment, linear / angular momentum? Outgassing materials, especially plastics and lubricants but also wire insulation and other sub-parts? Vacuum welding possible? Sufficient cooling and lubrication without air...
  • Pronouns

    Pronouns

    Punctuating Speech - a new line shows a change of speaker. We show each . change of speaker . by starting a new line. I forgot. I was being a pirate. Why didn't you lay the table? I will take...
  • CS/ENGRD 2110 (formerly CS 211) Fall 2009

    CS/ENGRD 2110 (formerly CS 211) Fall 2009

    Object-casting rule: At runtime, an object can be cast to the name of any partition that occurs within it —and to nothing else. a0 can be cast to Object, Animal, Cat. An attempt to cast it to anything else causes...
  • Match the Word to the correct Definition

    Match the Word to the correct Definition

    A pure substance made of two atoms chemically combined. A mixture in which you can see the individual parts. A pure substance that is made of only ONE kind of atom. A solute dissolved in a solvent. Heterogeneous. Element. Solution....
  • SGW WIMS task management solution - opssys.com

    SGW WIMS task management solution - opssys.com

    SGW also produced a number of more complex daily forms for tests like Cl2 demand, jar testing and chemical delivery. Although we were really happy with these forms we found it difficult to ensure all operators were using them as...
  • Pregnancy - Quia

    Pregnancy - Quia

    Hyperemia of the bladder may lead to blood in the urine. Renal function is most efficient when the woman lies in the lateral recumbent position and least efficient when the woman assumes a supine position. See statement on page 247...
  • Welcome to IS 2610 - University of Pittsburgh School of ...

    Welcome to IS 2610 - University of Pittsburgh School of ...

    Graph April 5, 2004 Graph Terminology Graph : vertices + edges Induced subgraph of a subset of vertices Connected graph: a path between every pair Maximal connected: there is no path from this subgraph to an outside vertex Representation Adjacency...
  • Capabilities and Limitations of ICT

    Capabilities and Limitations of ICT

    Disadvantages of relational database vs. flat files More complicated to design and create a relational database than a flat file system More expensive because flat file system can by created simply using spreadsheet software where as a relational database needs...