small size big problems

For rural districts, unexpected challenges in new evaluation system

Lauren Kelso, Mountain Valley's principal, and Corey Doss, the superintendent, in the district's main office.

As districts across Colorado roll out new state-mandated educator evaluations systems, rural districts are discovering challenges that few of their larger counterparts face.

Even in the small number of rural districts that piloted the program two years ago, administrators are still grappling with everything from how to rate teachers who teach multiple grade levels in one classroom to glitchy computer systems in districts with little tech support.

And in some rural districts with fewer than 200 students, administrative staff and teachers often play more than one role, which leads to obstacles that rural officials say weren’t accounted for when the evaluation law was written.

“When legislation comes down the pipe, schools like this don’t get thought about,” said Corey Doss, superintendent of the San Luis Valley’s Mountain Valley School District, which was one of 27 districts that began piloting the new evaluation system two years ago.

Doss wanted a head start on the program and to make sure that rural districts had a voice in providing feedback on the challenges. ”I wanted to make sure this district was on the right track,” he said.

Time burdens and technical glitches

Even in a district with two years’ practice under its belt, Doss found that the requirements of the law can overwhelm staff time.

“It’s great but it’s time-consuming,” said Doss, who oversees a staff that includes a single principal, a bookkeeper and a technology director in addition to teachers and facilities workers.

When the pilot first began, Doss split the work of evaluating teachers with his principal, Laura Kelso, but found that the load was too heavy with the rest of his responsibilities. So Kelso took on the task of evaluating the district’s teachers herself, a move that forced her last week to hire a substitute to oversee the school while she spent several days meeting with teachers.

In Mountain Valley, the evaluations have further sucked up staff time because of technical glitches in the system the district uses to manage all of the associated data and reports, BloomBoard.

Though the program has been praised by Bill Gates and other education advocates, Mountain Valley administrators say it is riddled with problems and the training they received was insufficient.

For example, teachers are supposed to score themselves using the same rubric as the evaluator. Those scores should then appear side by side in BloomBoard. But that’s not what’s happening.

“It is currently taking me two hours per teacher to do mid-term evaluation reviews because scores from me aren’t showing up,” said Kelso. The teacher should be able to look at both his or her own self-evaluation and Kelso’s side by side; instead, Kelso has to sit down with each teacher and go through the rubric score by score.

Additionally, the trainer who taught them how to use BloomBoard taught them incorrectly, so Kelso spent several hours fixing her inadvertent errors.

And Kelso says it’s not surprising that the trainer made mistakes. “It changes all the time,” she said, so new problems in the software keep arising.

Since Mountain Valley began using BloomBoard, the state has moved away from it. But that’s of little comfort to Mountain Valley officials, who already have their data loaded into it and can’t change systems.

Complexity pies

When the legislature passed the new educator effectiveness law in 2009, it laid out general requirements for what pieces must go into an evaluation, including classroom observations, proficiency and growth scores on both state and classroom tests.

Districts were then charged with working out exactly how much each element should factor in to a teacher’s evaluation. That process is happening for the first time this year, as the new system’s full rollout goes into effect.

The complex mandates of the new evaluation system are a particular challenge for small districts where the responsibility for designing and implementing the new system falls on a single person.

In Moffat Consolidated School District, like Mountain Valley, a single principal oversees a K-12 campus and doesn’t have any administrative support like she might in other districts. That means that many smaller tasks end up on her plate.

“There is no data person to pull the numbers,” said Kirk Banghart, Moffat’s superintendent.

Designing the breakdown of test scores–or “pies” as Kelso calls them — is especially difficult in places like Moffat or Mountain Valley, where a single teacher either teaches a single subject across as many six grade levels or a single grade level across a bunch of subject.

For example, Mountain Valley’s high school social studies teacher taught three grades but until this spring, none were tested. As a result, the test portion of that teacher’s evaluation came from math and literacy scores for those students.

At the opposite end of the spectrum, some teachers teach multiple grades, all of them tested. Balancing exactly how much of each category of testing should go into a teacher’s evaluation is a statistical challenge for principals like Kelso.

That means Kelso and Moffat’s principal, Michelle Hashbarger, must develop individual breakdowns for what goes into the testing portion of each teacher’s evaluation. Teachers have a say, as well, and Kelso plans to sit down with each teacher to discuss what their breakdown will look like, within the constraints of the law.

Banghart also said that with small classes, just a few students can skew the results for a teacher.

“It would take four or five years to get to enough students [for statistical power]”, he said.

For Kelso, the evaluation process is uncovering philosophical differences between her and her teaching staff about how they should be rated-questions that are being raised across the state.

“Teachers are feeling it’s really unfair,” Kelso said.

For example, her music teacher will see math and literacy scores from her students in her evaluations, despite the fact that she doesn’t teach those subjects. But Kelso believes the skills students learn in music do affect her students’ math scores.

“To me, the math in her content area could play an even bigger role for students,” Kelso said. “That’s a philosophical conversation we need to have.”

Kelso agrees with her teachers that elements of the law are unfair and she hopes to come up with breakdowns that remedy some of the problems. For her brand-new fourth grade math teacher, who will see state test scores from last year’s fourth graders in her evaluation, Kelso is planning to exclude internal growth scores from last year.

Instead, more emphasis will be put on how much the teacher is able to help her current students.

The evolution of the principal

For Kelso, the experience of overseeing the entire process, from designing the pies to observing the teachers, has made her wish for a rethinking of the role of the principal.

“Honestly I think there’s going to have to be some kind of change how administrations look,” Kelso said.

Other San Luis Valley districts with more staff have parceled out the responsibility to more people.

“In one [San Luis Valley] district with a lot more resources, one person designed all the pies,” said Kelso. But here, she’s the one person responsible for coming up with a solution.

Kelso says she fears that the burden on small districts may ultimately prove to be too great.

“The only ones who are going to be successful are [districts] with assistant principals and other admins,” Kelso said. But she’s trying to figure out work arounds for her small district. One good first step, she said, was banding together with two other San Luis Valley districts to hire a consultant to train administrators on the evaluation process.

Officials in both Moffat and Mountain Valley agree that the evaluations have changed the principal’s role.

In Moffat, the law raised questions of whether the person designing how teachers are evaluated should be the one hiring and firing them as well. As a result, Banghart and Hashbarger divided responsibilities — she designs and implements the evaluations and he makes the final call on hiring and firing.

The responsibilities have also limited the time both principals are able to spend providing instructional support to teachers.

For Kelso, who only has a single elementary literacy coach, she’s had to rethink about what kind of help she can provide.

“What’s my responsibility as an administrator to get them the help they need?” Kelso said.

Right now, all she’s had the time to do is get some of her new teachers books to read and talk about.

“I’m either evaluator or coach,” said Kelso. “It’s really hard to do both.”

pink slips

One Detroit principal keeps his job as others get the ax. Next year’s challenge? Test scores.

PHOTO: Brenda Scott Academy
Students at Brenda Scott Academy will have the same principal, Eric Redwine, next year.

Educators and staff from a Detroit middle school took the microphone on Tuesday evening to save their principal’s job. Addressing the school board, they listed off Eric Redwine’s virtues, arguing that recent problems at the school can be attributed to its transition from state to district management.

And the board listened. Redwine, principal of Brenda Scott Academy, kept his job in a narrow 4-to-3 vote. He was the only one to survive among more than a dozen other administrators — and three other principals — who either lost their jobs or were reassigned to new ones.

The vote came amid a quiet year for “non-renewals,” shorthand for losing one’s job. In previous years, every administrator in the district was forced to re-apply for their job every year, a tactic designed to give state-appointed emergency managers flexibility in the face of an unstable financial situation. This year, by contrast, only 16 administrators — including four principals — were notified by the superintendent’s office that their contracts would not be renewed, as Superintendent Nikolai Vitti seeks to bring stability to a district still recovering from repeated changes in management.

The principals were singled out for their school management, Vitti has said — not because of how students performed on tests. Test scores will be a major factor in principal contract renewals next spring for the first time under Vitti, part of the superintendent’s effort to meet his promise of boosting test scores.

Seven of the 16 administrators who received “non-renewals” asked the board to reconsider the superintendent’s decision. But in a vote on Tuesday evening, only Redwine survived. He’ll remain as principal of Brenda Scott Academy, according to board member LaMar Lemmons.

The other officials were not named, but Chalkbeat confirmed independently that the district did not renew its contracts with principals Sean Fisher, of Fisher Magnet Upper Academy, and Allan Cosma, of Ludington Magnet Middle School. Vitti previously attempted to remove Cosma, then agreed to offer him a job as assistant principal at Ludington.

At an earlier meeting, Cosma’s employees gathered to vouch for his work. On Tuesday, it was Redwine who received vocal support.

Redwine himself argued publicly that the problems identified at his school by administrators — teacher vacancies and school culture — could be attributed to the school’s transition from a state-run recovery district back to the main district. The recovery district, called the Education Achievement Authority, was created in 2012 to try to turn around 15 of the most struggling schools in the district but the effort was politically unpopular and had limited success. Most of the schools were returned to the main district last summer when the recovery district was dissolved. The only exceptions were schools that had been closed or converted to charter schools.

“I’ve never been told your job is in jeopardy, never been presented a corrective action plan,” Redwine said. “I ask that you reconsider your decision.”

Of the 12 schools that returned to the district last summer, most still have the principals who were in place during the transition last summer. A few got new principals this year after their predecessors left and at least one other former recovery district principal was moved earlier in the year.

Many school leaders reported that the transition was very difficult. It occurred at a time when Vitti was new and still putting his team into place in the central office, making it challenging for principals of the schools to get information they needed about the new district.

When Marcia Horge worked for Redwine, she appreciated his openness to classroom experimentation and his schoolwide Sunday night email, which laid out a game plan for the week ahead.

Then the recovery district folded, Brenda Scott Academy rejoined the main district, and Horge found herself facing a steep pay cut. Rather than accept credit for only two of her 17 years of teaching experience, she left for the River Rouge district. But now, with the Detroit district planning to fully honor teacher experience starting this fall, Horge is contemplating a return to work for Redwine.

“He’s open to our ideas,” she said. “You can go to him. And when there’s a need, he steps in and makes sure we’re communicating.”

 

meet the fellows

Meet the 38 teachers chosen by SCORE to champion education around Tennessee

PHOTO: SCORE
The year-long fellowships offered by the State Collaborative on Reforming Education were awarded to 38 Tennessee educators.

Six teachers from Memphis have been awarded fellowships that will allow them to spend the next year supporting better education in Tennessee.

The year-long fellowships, offered by the State Collaborative on Reforming Education, train and encourage teachers and other educators to speak at events, write publicly about their experiences, and invite policymakers to their classrooms. The program is in its fifth year through the nonpartisan advocacy and research organization, also known as SCORE, which was founded by former U.S. Senate Majority Leader Bill Frist from Tennessee.

The fellowships, known as the Tennessee Educator Fellowships, have been awarded to 150 educators since the program’s launch in 2014. This year’s class of 38 educators from around the state have a combined 479 years of experience.

“The fellows’ diverse perspectives and experiences are invaluable as they work both inside and outside the classroom and participate in state conversations on preparing all students for postsecondary and workforce success,” SCORE President and CEO Jamie Woodson said in a news release.

Besides the Shelby County teachers, the group also includes educators who work for the state-run Achievement School District, public Montessori schools, and a school dedicated to serving children with multiple disabilities.

The 2018-19 fellows are:

  • Nathan Bailey, career technical education at Sullivan North High School, Sullivan County Schools
  • Kalisha Bingham-Marshall, seventh-grade math at Bolivar Middle School, Hardeman County Schools
  • Sam Brobeck, eighth-grade math at Memphis Grizzlies Preparatory Charter Middle School. Shelby County Schools
  • Monica Brown, fourth-grade English language arts and social studies at Oakshire Elementary School, Shelby County Schools
  • Nick Brown, school counselor at Westmoreland Elementary School, Sumner County Schools
  • Sherwanda Chism, grades 3-5 English language arts and gifted education at Winridge Elementary School, Shelby County Schools
  • Richard J. Church, grades 7-8 at Liberty Bell Middle School, Johnson City Schools
  • Ada Collins, third grade at J.E. Moss Elementary School, Metropolitan Nashville Public Schools
  • Lynn Cooper,  school counselor at South Pittsburg High School, Marion County Schools
  • Colletta M. Daniels, grades 2-4 special education at Shrine School, Shelby County Schools
  • Brandy Eason, school counselor at Scotts Hill Elementary School, Henderson County Schools
  • Heather Eskridge, school counselor at Walter Hill Elementary School, Rutherford County Schools
  • Klavish Faraj, third-grade math and science at Paragon Mills Elementary School, Metropolitan Nashville Public Schools
  • Mavis Clark Foster, fifth-grade English language arts and science at Green Magnet Academy, Knox County Schools
  • Ranita Glenn, grades 2-5 reading at Hardy Elementary School, Hamilton County Department of Education
  • Telena Haneline, first grade at Eaton Elementary School, Loudon County Schools
  • Tenesha Hardin, first grade at West Creek Elementary School, Clarksville-Montgomery County Schools
  • Thaddeus Higgins, grades 9-12 social studies at Unicoi County High School, Unicoi County Schools
  • Neven Holland, fourth-grade math at Treadwell Elementary School, Shelby County Schools
  • Alicia Hunker, sixth-grade math at Valor Flagship Academy, Metropolitan Nashville Public Schools
  • Alex Juneau, third grade at John Pittard Elementary School, Murfreesboro City Schools
  • Lyndi King, fifth-grade English language arts at Decatur County Middle School, Decatur County Schools
  • Rebecca Ledebuhr, eighth-grade math at STEM Preparatory Academy, Metropolitan Nashville Public Schools
  • Aleisha McCallie, fourth-grade math and science at East Brainerd Elementary School, Hamilton County Department of Education.
  • Brian McLaughlin, grades 10-12 math at Morristown-Hamblen High School West, Hamblen County Schools
  • Caitlin Nowell, seventh-grade English language arts at South Doyle Middle School, Knox County Schools
  • Paula Pendergrass, advanced academics resources at Granbery Elementary School,  Metropolitan Nashville Public Schools
  • Julie Pepperman, eighth-grade science at Heritage Middle School, Blount County Schools
  • Kelly Piatt, school counselor at Crockett County High School, Crockett County Schools
  • Ontoni Reedy, grades 1-3 at Community Montessori, Jackson-Madison County Schools
  • Tiffany Roberts, algebra and geometry at Lincoln County Ninth Grade Academy, Lincoln County Schools
  • Craig Robinson, grades 3-5 science at Georgian Hills Achievement Elementary, Achievement School District
  • Jen Semanco, 10th- and 11th-grade English language arts at Chattanooga Girls Leadership Academy, Hamilton County Department of Education
  • Amanda Smithfield, librarian at Hume-Fogg Academic Magnet School, Metropolitan Nashville Public Schools
  • Cyndi Snapp, fourth-grade math at Carter’s Valley Elementary School, Hawkins County Schools
  • David Sneed, 12th-grade English at Soddy Daisy High School, Hamilton County Department of Education
  • Yolanda Parker Williams, fifth-grade math at Karns Elementary School, Knox County Schools
  • Maury Wood II, grades 4-6 technology at Westhills Elementary School, Marshall County Schools