prep problems

A new study shows why it’s so hard to improve teacher preparation

Dramatically reshaping how teachers are trained — by emulating great teacher preparation programs and shutting down ineffective ones — has been a key priority of many states and even, under the Obama administration, the federal government.

Fierce debates have ensued over how to hold training programs accountable for making sure novice teachers are ready for the classroom on day one.

Now a new study casts doubt on those efforts for a simple reason: It’s hard to identify good or bad teacher preparation programs, at least as measured by student achievement.

That’s the provocative conclusion of research by Paul von Hippel of University of Texas at Austin and Laura Bellows of Duke University.

“It appears that differences between [programs] are rarely detectable, and that if they could be detected they would usually be too small to support effective policy decisions,” write von Hippel and Bellows.

The study, which has not been formally peer-reviewed, follows other peer-reviewed research comparing teacher training programs in Florida, Louisiana, Missouri, New York City, Texas and Washington.

Those studies try to isolate the impact of teacher preparation programs — including schools of education and alternative certification initiatives — on student test scores. It’s a difficult task, since there are two degrees of separation between a teacher training program and students taking state tests, and researchers use complex value-added models to control for a number of factors.

The studies come to differing conclusions. Some suggest that programs vary substantially in effectiveness, but most find few clear differences among a state’s programs.

In the latest research, von Hippel and Bellows reanalyze those six studies using a consistent method. They find that in all states the differences between teacher preparation programs are small and it’s difficult to pick out top-notch programs with confidence.

“This is troubling because singling out [programs] is a prerequisite to the policy goal of expanding strong [programs] and shuttering weak ones,” they write.

Indeed, a number of states — 16, according to the researchers — have made efforts to evaluate training programs based in part on value-added measures. The Obama administration issued regulations encouraging states to evaluate their teacher prep programs by measuring student learning, though they were scrapped by Congress and the Trump administration earlier this year.

Dan Goldhaber, who has studied Washington’s teacher training programs and is a professor at the University of Washington, said this latest study is consistent with his own findings.

“I think there’s relatively little variation in the value-added effectiveness of teachers who hold credentials from different programs,” he said.

Still, he notes, the size of the impact is in the eye of the beholder. At most, the difference between attending a good versus an average training program is comparable to the difference in effectiveness between the average first- and third-year teacher — definitely not big, but not necessarily zero.

An inherent limitation of this research is that it focuses exclusively on the fraction of teachers who end up in tested grades and subjects, largely fourth- through eighth-grade math and English.

It may be more helpful to judge teacher preparation programs by multiple measures. For instance, recent research has found that there is substantial variation in how different programs affect teachers’ scores on classroom observations, which can be used to evaluate all teachers, not just those in tested areas.

Still, isolating the impact of training remains a challenge, since teachers are not randomly assigned to schools, and some programs aim to place teachers in high-poverty schools where attaining high ratings may be more difficult.

Bellows, the Duke researcher, warned against chasing after programs that might be appear effective simply because of a statistical fluke.

“You don’t want to remodel our [teacher preparation programs] based on one that looks really good when … it’s just by chance,” she said.

However, Bellows and von Hippel’s research suggests that there is some reason for optimism. In five of the six states, there was at least one large program that appears significantly better at preparing teachers in at least one subject.

“If we are very careful, we can occasionally identify a [program] that is truly exceptional,” they write.

Detroit week in review

Week in review: The state’s year-round scramble to fill teaching jobs

PHOTO: DPSCD
Miss Michigan Heather Heather Kendrick spent the day with students at the Charles H. Wright Academy of Arts and Science in Detroit

While much of the media attention has been focused this year on the severe teacher shortage in the main Detroit district, our story this week looks at how district and charter schools throughout the region are now scrambling year-round to fill vacant teaching jobs — an instability driven by liberal school choice laws, a decentralized school system and a shrinking pool of available teachers.

The teacher shortage has also made it difficult for schools to find substitutes as many are filling in on long-term assignments while schools try to fill vacancies. Two bills proposed in a state senate committee would make it easier for schools to hire retirees and reduce the requirements for certifying subs.  

Also, don’t forget to reserve your seat for Wednesday’s State of the Schools address. The event will be one of the first times in recent years when the leader of the city’s main district — Nikolai Vitti — will appear on the same stage as the leaders of the city’s two largest charter school authorizers. For those who can’t make it, we will carry it live on Chalkbeat Detroit.

Have a good week!

– Julie Topping, Editor, Chalkbeat Detroit

STATE OF THE SCHOOLS: The State of the Schools address will pair Vitti with the leaders of the schools he’s publicly vowed to put out of business, even as schools advocates say city kids could benefit if the leaders of the city’s fractured school system worked together to solve common problems.

LOOKING FOR TEACHERS: The city’s teacher shortage mirrors similar challenges across the country but the problem in Detroit is exacerbated by liberal school choice policies that have forced schools to compete with each other for students and teachers.

Hiring efforts continue at Detroit’s main school district, which is planning another job fair. Head Start centers are also looking for teachers. Three new teachers talk about the challenges, rewards and obstacles of the classroom.

WHOSE MONEY IS IT? The state Senate sent a bill to the House that would allow charters to receive a portion of property tax hikes approved by voters. Those funds have historically gone only to traditional district schools.

UNITED THEY STAND: Teachers in this southwest Detroit charter school voted to join a union, but nationally, union membership for teachers has been falling for two decades.

COLLEGE AND CAREERS: A national foundation based in Michigan granted $450,000 to a major Detroit business coalition to help more students finish college.

High school seniors across the state will be encouraged to apply to at least one college this month. The main Detroit district meanwhile showed off a technical center that prepares youngsters and adults for careers in construction, plumbing and carpentry and other fields.  

STEPS TO IMPROVEMENT: A prominent news publisher explains why he told lawmakers he believes eliminating the state board of education is the right thing to do. An advocate urged Michigan to look to other states for K-12 solutions. And one local newspaper says the governor is on the right track to improving education in Michigan.

This think tank believes businesses should be more engaged in education debates.

LISTEN TO US: The newly elected president of a state teachers union says teachers just want to be heard when policy is being made. She wrote in a Detroit newspaper that it takes passion and determination to succeed in today’s classrooms.

A PIONEER: Funeral services for a trailblazing African American educator have been scheduled for Saturday.

Also, the mother-in-law of U.S. Education Secretary Betsy DeVos, died in her west Michigan home.

FARM-TO-SCHOOL:  A state program that provides extra money to school districts for locally grown produce has expanded to include more schools.

BETTER THAN AN APPLE: Nominate your favorite educator for Michigan Teacher of the Year before the 11:59 deadline tonight.

An Ann Arbor schools leader has been named the 2018 Michigan Superintendent of the Year by a state group of school administrators.

MYSTERY SMELL: The odor from a failed light bulb forced a Detroit high school to dismiss students early this week.

EXTRA CREDIT: Miss Michigan encouraged students at one Detroit school to consider the arts as they follow their dreams. The city schools foundation honored two philanthropic leaders as champions for education.

And high school students were inspired by a former college football player. 

Struggling Detroit schools

The list of promises is long: Arts, music, robotics, gifted programs and more. Will Detroit schools be able to deliver?

PHOTO: Detroit Public Television
Detroit schools Superintendent Nikolai Vitti answers questions at a community meeting in Detroit.

Arts. Music. Robotics. Programs for gifted kids. New computers. New textbooks. Dual enrollment programs that let high school students take college classes. International Baccalaureate. Advanced Placement.

They’re all on the list of things that Detroit schools Superintendent Nikolai Vitti told a group of community members assembled in a Brightmoor neighborhood church that he would introduce or expand as soon as next school year.

Vitti didn’t get into the specifics of how the main Detroit district would find the money or partnerships needed to deliver on all of those promises, but they’re part of the plan for the future, he said.

The comments came in a question and answer session last month with students, parents and community members following Vitti’s appearance on Detroit Public Television’s American Black Journal/One Detroit Roadshow. The discussion was recorded at City Covenant Church. DPTV is one of Chalkbeat’s partners in the Detroit Journalism Cooperative.

Vitti has been appearing at community events since taking over the Detroit schools last spring. He is scheduled next week to join officials from two of the city’s major charter school authorizers, Central Michigan University and Grand Valley State University, at a State of the Schools address on October 25.

 

Watch the full Q&A with Vitti below.