Randi Weingarten says students in strong union states perform better academically

Education was the topic du jour on ABC's This Week on Aug. 29, 2010, and the discussion quickly came around to teachers unions.

This Week host Christiane Amanpour asked Randi Weingarten, president of the American Teachers Federation, how schools can get around huge impediments in many collective bargaining agreements to getting rid of bad teachers.

Weingarten responded with a quick defense of teachers unions.

"Let me say this," Weingarten said. "First, the states that actually have lots of teachers in teacher unions tend to be the states that have done the best in terms of academic success in this country. And the states that don't tend to be the worst.

"The issue is not a teacher union contract or a teacher union-management contract. What we have to do with these contracts is we have to make them solution-driven."

We decided to check Weingarten's claim that states that "have lots of teachers in teachers unions tend to be the states that have done the best in terms of academic success."

We realize we are wading into some treacherous waters here. An intense debate has raged for years over the effect of teacher unions on student achievement. On one side, you have those who believe unions act as an impediment to necessary school reforms; make it difficult to get rid of bad teachers, and oppose ideas like merit pay to encourage better teaching. On the other side are those who argue strong unions lead to better-paid, better-supported teachers, which helps to attract and retain better teachers and, in turn, contributes to improved student achievement.

Weingarten's statement not only makes an absolute claim about better academic performance in states with strong unions, it implies unions are the reason why -- otherwise, why cite it?

We contacted the American Federation of Teachers, which represents about 1.4 million K-12 teachers in the United States, to get backup for Weingarten's claim. Initially, spokesman John See pointed us toward a state-by-state breakdown on collective bargaining policies -- such as whether the state has a "right to work" law or allows strikes. And he included links to comparisons of academic achievement by state from the National Center for Education Statistics and Education Week. Strong union states like Maryland, Massachusetts and New York, See said, were among the highest ranked in these 2010 reports.

Later, See also forwarded links to several studies linking teacher unions to higher student achievement.

The first is a study published in 2000 in the Harvard Educational Review. According to the abstract: "Comparison of standardized test scores and degree of teacher unionization in states found a statistically significant and positive relationship between the presence of teacher unions and stronger state performance on tests. Taking into account the percentage of students taking the tests, states with greater percentages of teachers in unions reported higher test performance."

The second is a 2002 survey of studies by Robert M. Carini of Indiana University Bloomington, who found that "While only 17 prominent studies have looked at the teacher union-achievement link, the evidence suggests that unionism raises achievement modestly for most students in public schools." However, Carini wrote that while studies seem to suggest that unions benefit middle range students, who are the majority, "a union presence was harmful for the very lowest- and highest-achieving students."

"In fact, public opinion is split as to whether teacher unionism is harmful or helpful to educational outcomes," Carini wrote. "Considering both this general perception and the considerable rhetoric from both critics and supporters of unions, it is surprising that so little research exists on the unionism-achievement link. Still, the overall pattern in the research is increasingly clear; teacher unionism favorably influences achievement for most students in public schools."

In an e-mail, See said the reports "make the positive findings pretty clear."

If there were only one way to measure this statistic, See might be right. But, in fact, there are lots of variables in play.

A 2008 paper written by Nathan Burroughs, a visiting research associate at the Center for Evaluation and Education Policy, cited numerous studies that seemed to make the case both for and against unions with regard to student achievement.

"Ideally, the proper role of collective bargaining in public education could be settled by a consensus in the research literature," Burroughs wrote in his paper, Arguments and Evidence: The Debate over Collective Bargaining's Role in Public Education. "Regrettably, no such consensus exists."

Featured Fact-check

Instagram posts

stated on November 12, 2024 in an Instagram post

Elon Musk and Vivek Ramaswamy are “part of the World Economic Forum.”

"While a body of research exists suggesting that collective bargaining results in greater student achievement (usually measured through standardized test scores, most commonly the SAT), another body of work suggests the opposite," Burroughs wrote. "To complicate matters, both veins of research generally employ different analytical and statistical methods, making a clear-cut comparison somewhat elusive. In addition, there is a limited number of quality research studies dedicated to the effects of collective bargaining on student achievement."

What gives? For one, the studies that showed a positive effect from unions typically examined student achievement at a single point in time; while studies that showed lower student achievement in states with stronger unions usually measured achievement over time. We spoke to Burroughs, who explained that while a snapshot might show better scores in an affluent state compared to a poor one; students in an affluent state might improve less dramatically over time than a poor one, producing dramatically different results. It's simply two different ways to measure a school's performance.

"The intensity of the debate over the role of collective bargaining has obscured the fact that empirical evidence supports either side of the discussion," Burroughs concluded. "There can be no verdict on whether collective bargaining in public education is 'bad' or 'good,' because there is insufficient evidence to warrant a definitive judgment. Much of the research on the effects of collective bargaining focuses on only one or two elements of the question or has results that appear dependent on a particular methodological strategy."

In addition, Burroughs cautioned that collective bargaining is most likely an indirect causal factor when it comes to student achievement; as opposed to direct factors such as income or parental education.

"It could be a spurious relationship," Burroughs told us. "The data really isn't there. When it comes to making claims about unions and student performance, it's just not clear. I think it's more constructive to focus on other things."

We also spoke to Andy Rotherham, co-founder of the non-profit Bellwether Education Partners, an education columnist for TIME.com and the blog Eduwonk.com, and co-editor of the book "Collective Bargaining in Education."

"On its face, it's true," Rotherham said of Weingarten's claim. "Massachusetts (a strong union state) does better than Virginia or Alabama. What it ignores is all of the things that influence student achievement."

"It's a classic correlation-causation fallacy," said Rotherham, who previously served at the White House as Special Assistant to the President for Domestic Policy during the Clinton administration.

Ultimately, he said, research is mixed and there is no study that can definitively settle whether unions are, or are not, the problem with student achievement.

"Sweeping statements one way or the other on this should be viewed with suspicion," Rotherham said.

We agree. Weingarten's claim that states that have lots of teachers in teacher unions tend to be the states that have done the best in terms of academic success is perhaps technically correct -- at least by some measures. But the empirical scientific research on this subject is -- in the words of Burroughs -- "limited, ambiguous and incomplete." Further, there is even less evidence to support the implication that strong unionization is the cause for one state performing better than another. And so we rate Weingarten's claim Half True.