Promise, perils of new online tests

TOWNSEND, Del. – On a recent afternoon at Townsend Elementary School here, a little boy squinted at a computer screen and gripped his mouse. He was stuck. Half of the screen contained an article about rainforests. The other half was filled with questions, some multiple-choice, some not.

One question asked the boy to pick two animals that belonged in the rainforest from a list of pictures and written descriptions. Then he was supposed to drag the animals across the screen onto the rainforest background. Next, he had to move two correct descriptions of rainforest characteristics into boxes. He raised his hand.

“I don’t understand,” he whispered to his fourth-grade teacher.

“Read the directions again,” she whispered back.

Delaware is one of a handful of states that has moved all of its testing online. On a recent visit to Townsend, students were filing into the computer lab throughout the day to take tests. But if a multi-state effort to create better tests is successful, the vast majority of American schoolchildren will be taking standardized math and English tests online in three years.

Some education reformers and technology experts are hailing the move, which has the backing of the Obama administration, as a revolution. They are promising more well-rounded tests, less frequent cheating and immediate feedback for both students and teachers, as students’ answers are transmitted quickly over the Internet to states and the results are then sent back to districts.

But other educators and experts point to a host of potential problems. Shrinking school budgets could make it difficult for districts to purchase new equipment, and states that pioneered online tests have dealt with network meltdowns. Some worry that the move to online testing could take time away from learning.

The online format allows states to give standardized tests—once just a weeklong ordeal at the end of the year—as often as four times a year. It’s an opportunity that early adopters like Delaware have already embraced.

“This is so thrilling and exciting for those of us who work with schools,” said Joe Willhoft, executive director of the Smarter Balanced Assessment Consortium, one of two groups developing the new tests. “Not only will we have the end-of-the-year test, but we will also have tests that teachers can use throughout the year that can help students.”

44 states, D.C. adopting new online tests by 2014-15

Townsend Elementary, which is located in the Appoquinimink School District, gives students additional computer-based tests each year that teachers say are more fine-tuned than the state exams. “It used to be testing week,” said Charles Sheppard, the principal at Townsend. “Now we just test.”

“It used to be testing week. Now we just test.”
– Delaware school principalForty-four states and Washington, D.C., plan to adopt new tests by the 2014-15 school year under a program funded by the Obama administration. The states have divided into two groups that are sharing $330 million from a federal competition to develop different versions of the online tests, which will be tied to a set of common standards established in 2010.

But states that have already experimented with online testing, including Virginia and Wyoming, provide a cautionary tale against shifting to computer-based tests too rapidly.

Wyoming switched from paper-and-pencil to online tests in 2010, but technical problems popped up everywhere. Online testing was such a debacle that voters threw the state superintendent out of office and the state sued NCS Pearson Inc., the company hired to design and administer the test. The state went back to old-fashioned paper exams.

In Virginia, by contrast, the switch to online tests went more smoothly. Over the course of a decade, Virginia expanded online testing incrementally, starting in high school and moving down to earlier grades. The state also invested nearly $650 million in new technology.

But despite its careful rollout, in 2007, nearly 10,000 students were unable to complete online exams—administered by Pearson Educational Management—after a series of technical glitches.

Bryan Bleil, Pearson’s vice president for online and technology implementation, says the company is working with states and districts to help them make the transition to computer-based testing—ensuring they have enough Internet bandwidth, for example, to handle the cyber traffic during testing times.

The company stands to gain as states contract out work on test development. In January, Pearson won a $500,000 contract from the state groups developing the tests to create a “technology readiness tool” for districts, to help them determine whether they have enough computers, for example.

Some states planning to keep paper exams as backup

The states in the two groups adopting online tests will launch them in a fraction of the time that Virginia took. And unlike Virginia, many don’t have money to put toward technology upgrades.

Maryland, which has administered science tests online for four years, plans for all of its tests to be taken on computers in three years. But Bill Reinhard, a spokesman for the Maryland State Department of Education, says his state has asked test-makers to keep paper-and-pencil exams as a backup. “We don’t have enough hardware,” he said.

Kayleen Irizarry, assistant superintendent for elementary and secondary education in D.C.’s state education office, said glitches are “always a concern.” So next year, some schools in the city may pilot low-stakes exams on computers in preparation for the district-wide launch.

Yet the test developers hope that eventually, technology in schools will improve enough to allow for more challenging and stimulating tests. In these new exams, a student might be asked to use a mouse to move the sides of a shape on screen into an isosceles triangle, highlight the main idea of a passage, or write an essay about two articles supplemented by their own online research.

In Delaware, however, the rainforest question, where students simply click and drag their answers across the computer screen, is “as adventurous as we’ve gotten,” said Michael Stetter, the state director of accountability resources.

“The big blowups we’ve had with cheating, it’s just not going to happen.”
– National testing officialEven if the move to more sophisticated tests takes a while, advocates for the new online exams point to other benefits. If a roomful of students switches a wrong response to the right one on the same question—suggesting someone might be coaching them—the computer can easily flag the pattern as possible cheating.

“The big blowups we’ve had with cheating, it’s just not going to happen,” said Doug Levin, executive director of the State Educational Technology Directors Association.

The shift to computer-based testing also corresponds with a push to make students digitally literate. And instantaneous scoring by computers will allow teachers, students and parents to see test results right away, rather than having to wait weeks or months after the school year has ended.

Don Davis, principal of Brick Mill Elementary, in Delaware’s Appoquinimink district, has mixed feelings about the tests, including whether they might widen the achievement gap for low-income students who don’t have computers at home. But, he said, “It’s better than what we used to have.”