Providence Mayor Angel Taveras says that Achievement First charter schools in Connecticut and New York outperform city and state averages on standardized tests

Politicians, parents and education officials are wrangling over a proposal by Achievement First to open two charter schools in Providence. Supporters say the charter school operator will be able to better educate poor and minority students. Opponents, however, question some of their teaching methods and worry that charter schools will channel money from traditional city-run schools that are already financially strapped.

Providence Mayor Angel Taveras is among those in Achievement First’s corner. In a Jan. 8, 2011, commentary in The Sunday Journal, he pointed to the success of schools operated by the organization in two nearby states.

"In Connecticut and New York, students at Achievement First schools consistently outperform city and statewide averages," the mayor wrote.

That’s essentially the basis of Achievement First’s pitch. According to test scores, the nonprofit organization says, its schools do better than others in their communities and can even compete with those in affluent communities.

Many have waded into this debate already. There are claims and counterclaims about the improvements Achievement First’s schools have made on test scores in Connecticut and New York. We decided to examine the issue ourselves.

We contacted Taveras’ office first and asked for data to back up the mayor’s statement. While we waited, we started our own search.

We began with Achievement First’s website, which lists test results for all of its schools. But the site averages results for math, reading and writing together, so it’s impossible to get a clear picture of how the schools did in individual subjects.

We wanted to analyze precise scores, not averages, so we went directly to the sources for testing data. Both the Connecticut State Department of Education and the New York State Education Department make test results available on their websites.

Before we get to the test scores, it’s helpful to have some background on Achievement First, which operates 10 schools in Connecticut and 10 in New York.

Its flagship, Amistad Academy, opened in New Haven, Conn., in 1999 with a mission to serve underprivileged children. The school has since expanded and so has the organization’s reach, moving into Hartford, Bridgeport and New York City. Achievement First’s approach includes a longer school day, more days in the school year, strict discipline and a focus on reading and math.

Taveras uses the present tense in his claim, so we examined results from the most recent years, 2010 and 2011.

Because the 20 schools opened at different times and because Achievement First typically starts each school with a single grade and then expands, testing data varies for each year and each school. For some schools, there is only one year of test results. For others, there is six years of results.

In considering test results, we used the percentage of students that meet or exceed the standard. (In Connecticut, this is considered being at or above proficiency.) Achievement First argues that a greater percentage of students in its schools meet the standard or are proficient than state and city averages, so we’ll focus our attention on these results.

We’ll look at Connecticut first. All students in grades 3-8 take the Connecticut Mastery Test (CMT), which tests students in math, reading and writing. Fifth graders and eighth graders are also tested in science. All 10th graders take the Connecticut Academic Performance Test (CAPT), which tests them in math, science, reading and writing.

In 2010, students in four Achievement First schools were tested on the CMT, totaling 16 classes in six grades.

For math, 11 of those classes exceeded the state average for the percentage of students at or above proficiency. Fifteen of  the 16 exceeded city averages. For example, of the 51 seventh graders at Elm City College Preparatory Middle School, in New Haven, 92.2 percent were proficient or better. The state average was 87.2 percent and the city average was 75.2 percent.

In the other subjects, Achievement First schools didn’t do as well, with only 4 of 16 classes exceeding the state average in reading and 8 of 16 in writing. Thirteen of the 16 classes did better than city averages in reading and 14 of 16 in writing.

The 2011 exams followed a similar pattern. Twenty Achievement First classes in four schools took the tests and 12 exceeded the state average on math while all 20 exceeded city averages. In reading, however, only three exceeded the state average while 16 exceeded city averages. And in writing, 10 exceeded the state average while 19 exceeded city averages.

For the CAPT, the only Achievement First high school -- Amistad Academy -- outdid city averages in all subject areas in both 2010 and 2011 and all state averages except in reading in 2010.

The results so far: students in Connecticut Achievement First schools do well in math, not as well in reading and writing.

Now let’s look at New York. Students in grades 3-8 in that state take the New York State Tests in math and English language arts.

In 2010, students in four Achievement First schools were tested, totaling 18 classes in six grades. For math, 15 of those classes exceeded the state average for the percentage of students that met the standard or did better. All 18 exceeded the city average.

On the English portion of the exam, only 1 of the 18 Achievement First classes exceeded the state average and only 6 of the 18 exceeded the city average.

Results for the 2011 exam were similar. Twenty-one Achievement First classes in five schools took the tests and all 21 exceeded the state and city averages on math. In English, however, only seven exceeded the state average and 12 exceeded the city average.

Before making our ruling, we should point out that Taveras’ office did eventually send us data that was nearly the same as what we found ourselves. The only difference was that for New York, Taveras’ office compared the results of Achievement First’s schools to district results, not citywide results.

We chose citywide results, because in his commentary in The Journal, Taveras made the comparison to city averages. If district results were used, the Achievement First schools would have fared better, especially in English.

Our ruling

Achievement First schools do outperform city and state averages for math in Connecticut and New York, but the results aren’t as definitive for other subjects.

To quantify this, we added up the number of classes that were tested in the two states in 2010 and 2011 and totaled the number of times the class results in different subject areas could be compared with either state or city averages.

Here’s what we found:

In total, for all grades and all subjects in the two states, Achievement First outperformed state or city averages 66 percent of the time. (If the New York district averages provided by Taveras’ office were substituted for city averages, this number would have risen to 70 percent.)

Generally, combining all grades and all subjects, Achievement First schools performed better than their home cities, scoring better 83 percent of the time. Compared with state averages, however, they scored better only 50 percent of the time.

Achievement First schools also did better on math, scoring higher than state or city averages 87 percent of the time. But in other subject areas -- science, reading and writing -- they had higher averages only 54 percent of the time.

Taveras said that Achievement First schools in Connecticut and New York "consistently outperform city and statewide averages." That’s true for math but it’s not true for other subjects. It’s true for city averages but not for statewide averages.

In other words, the mayor overstated the case for the charter school operator. We rule the claim Half True.

(Get updates from PolitiFactRI on Twitter. To comment or offer your ruling, visit us on our PolitiFact Rhode Island Facebook page.)

Featured Fact-check

Lincoln Chafee

stated on May 4, 2010 in a candidate forum

"Fifty-three percent of teens in Central Falls are getting pregnant."