Most Used Tips On How To Choose The Best Steak

The steak. Almost a staple in our diets. However, not all steaks are created equal, there are those delicious steaks, and then there are the godly tasting steaks. Knowing the subtle differences can me...

News Company - avatar News Company

3 Tips for Improving Your Physical Fitness, When You're Starting from a Pretty Bad Place

Fitness is one of the most important things in life for overall health and wellness – and maintaining a regular fitness routine has all sorts of potential benefits, ranging from better medical outco...

News Company - avatar News Company

Top 5 Events to Enjoy in the United Kingdom Every Year

The United Kingdom as any country holds numerous engaging festivals throughout the year. What makes the UK offer to stand out from the rest is their exciting travel landmarks and cities that nearly ...

Goran Kezić - avatar Goran Kezić

Friday essay: YouTube apologies and reality TV revelations - the rise of the public confession

A little over a year ago, former Australian cricket captain Steve Smith made a tearful confession and apology to the public, having been banned from cricket for 12 months for ball tampering. Smith&rsq...

Kate Douglas, Professor, Flinders University - avatar Kate Douglas, Professor, Flinders University

Population DNA testing for disease risk is coming. Here are five things to know

Screening millions of healthy people for their risk of disease can be cost-effective. But it raises ethical and regulatory concerns.from www.shutterstock.comDNA testing to predict disease risk has the...

Paul Lacaze, Head, Public Health Genomics Program, Monash University - avatar Paul Lacaze, Head, Public Health Genomics Program, Monash University

Why Sydney residents use 30% more water per day than Melburnians

Melbourne's water supplies are running low after years of drought.shutterstockThis week Melbourne’s water storage dropped below 50%, a sign of the prolonged and deepening drought gripping easter...

Ian Wright, Senior Lecturer in Environmental Science, Western Sydney University - avatar Ian Wright, Senior Lecturer in Environmental Science, Western Sydney University

From gun control to HIV: six ingredients of successful public policy

Australia’s national policy response to HIV/AIDS has been lauded as one of the best in the world.ShutterstockIn the lead up to the recent federal election, there was plenty of negative rhetoric ...

Joannah Luetjens, PhD Candidate, Utrecht University - avatar Joannah Luetjens, PhD Candidate, Utrecht University

How the dangerous evolution of Pakistan’s national security state threatens domestic stability

Protests followed the terrorist attack that killed more than 40 Indian military personnel in the disputed state of Jammu and Kashmir. AAP/Jaipal Singh, CC BY-NDIn February, a terrorist attack by Jaysh...

Robert G. Patman, Professor of International Relations, University of Otago - avatar Robert G. Patman, Professor of International Relations, University of Otago

Taming wild cities: the tall buildings of Australia show why we need strong design guidelines

Towering canyons of concrete and glass are an increasingly dominant feature of fast-growing cities like Melbourne.ymgerman/ShutterstockPrivate enterprise has shaped the skylines of Australia’s c...

Timothy Moore, PhD Candidate, Melbourne School of Design, Monash University - avatar Timothy Moore, PhD Candidate, Melbourne School of Design, Monash University

Let them play! Kids need freedom from play restrictions to develop

Playing in nature improves children's learning, social and emotional skills.MI PHAM/unsplashYou may have heard of play. It’s that thing children do – the diverse range of unstructured, spo...

Brendon Hyndman, Senior Lecturer and Course Director (Postgraduate Education courses), Charles Sturt University - avatar Brendon Hyndman, Senior Lecturer and Course Director (Postgraduate Education courses), Charles Sturt University

If you think less immigration will solve Australia's problems, you're wrong; but neither will more

More by luck than design, recent recent levels of immigration seem to be in a 'goldilocks zone' that balances economic, social and environmental objectives.www.shutterstock.comAre we letting too many ...

Cameron Allen, Researcher, UNSW - avatar Cameron Allen, Researcher, UNSW

Gamers use machine learning to navigate complex video games – but it's not free

Playing Dota 2? You can do better with a little help from machine learning.Shutterstock/hkhtt hj Some of the world’s most popular video games track your activity as you play – but they&rsq...

Ben Egliston, PhD candidate in Media and Communications, University of Sydney - avatar Ben Egliston, PhD candidate in Media and Communications, University of Sydney

Grattan on Friday: Shocked Labor moves on – but to what policy destination?

Bill Shorten has said he likes doing the family shopping, nevertheless Tuesday’s front page picture in The Australian did capture the savagery of changing political fortunes. There was Shorten, ...

Michelle Grattan, Professorial Fellow, University of Canberra - avatar Michelle Grattan, Professorial Fellow, University of Canberra

Narendra Modi has won the largest election in the world. What will this mean for India?

Narendra Modi's image was ubiquitous on the campaign trail – a sign of how much Indians have gravitated toward his cult of personality and nationalist rhetoric.Harish Tyagi/AAP The resounding vi...

Amitabh Mattoo, Honorary Professor of International Relations, University of Melbourne - avatar Amitabh Mattoo, Honorary Professor of International Relations, University of Melbourne

imageHow do you measure the value of a charter school?Reuters/Lee Celano

Imagine a police officer pulls you over and tickets you for speeding. She tells you she measured you going 50.5 MPH in a 50 MPH zone. No, you reply, my speedometer shows that I was going exactly 49.5. The entire discussion would be absurd, since neither your speedometer nor the officer’s radar gun is sufficiently accurate to support the opposing claims, and a 0.5 MPH difference is not practically meaningful.

Welcome to the world of debates about the effects of American charter schools on children’s test scores. This was all underscored last year when advocates of charter schools – which are publicly funded but independent – reacted to a high-profile study released by CREDO, a charter-friendly research unit connected to Stanford University. The study showed great variation between different charter schools and between states.

The CREDO study also offered an overall national estimate showing students in charter schools scoring approximately 0.01 standard deviations higher on reading tests and 0.005 standard deviations lower on math tests than their peers in conventional public schools (the former being statistically significant; the latter not). These findings were, in fact, highly consistent with an overall body of researchconcluding that the test-score outcomes of charter schools and public schools are almost identical.

Notwithstanding these pedestrian results as well as some limitations and problems with the study itself, the results were seized upon by advocates and resulted in headlines such as, Stanford Study Says Charter School Children Outperform and Study: Minority, poor students gain from charters.

Bangs for the buck

Even more recently, the staunchly pro-charter Department of Education Reform at the University of Arkansas attempted to shift the discussion to issues of productivity, arguing that charter outcomes look more impressive when we take inputs such as resources into account. In a report called The Productivity of Public Charter Schools they put forward the contention that charter funding per child is relatively low compared to regular public schools, so the charter sector is more productive.

This report generated headlines such as: A bigger bang for school bucks and Charter schools: More bang for the buck. But huge problems undermined the Arkansas report’s figures for both financial inputs into schools and outputs such as test scores.

This brings us right back to the speeding ticket. The lack of controlled laboratory conditions for this kind of research overwhelms attempts to isolate small differences that might be inherent in charter versus non-charter status. Since many school districts, for example, are called upon to provide services such as transportation to charter schools, any attempt to measure the resources put into the charter system in those jurisdictions should assign a cost to the school districts and a benefit to the charter schools. Yet the Arkansas report does the opposite.

Sensible estimates on school outputs, such as analyses of test scores, would attempt to compare like with like – comparing schools with similar demographics like poverty (measured by free lunch eligibility) or special-needs status – but the Arkansas report fails to do that too.

Even analyses that do try to control for such variables come up short, given that part of the variance is undoubtedly due to non-random but unmeasured factors – such as parental differences linked to motivation for seeking out a charter school.

More variation between charters

Some researchers have attempted to get around these bias issues by studying charter schools that are over-enrolled and that use lotteries to select which students to admit. But these studies suffer from at least two limitations.

First, they only allow for studies of over-enrolled, popular charter schools, thus undermining the ability of the research findings to be generalized to the larger population that includes less popular charter schools.

Second, parents tend to wreak havoc on the control groups in such studies by continuing to seek out other options, whether they be other charters, selective public schools, or even private schools. In other words, it’s difficult to get a clear picture.

In any case, while researchers aspire to make sweeping conclusions that compare the charter sector to the traditional public school sector, the variation among schools of the same type swamps any differences between charter and public schools that we might be able to tease out.

This shouldn’t come as a surprise. Students learn when they have opportunities to learn, and the quality and quantity of those opportunities vary greatly among different charter schools and among different traditional public schools. Our own research at the National Education Policy Center suggests very large resource differences among charter schools. This is in accord with longstanding research showing such differences among traditional public schools.

Feeding research into policy

None of this means research cannot help us understand charter schools. The fact that the studies that do exist find little overall difference between charters and non-charters is itself important. Even with the limitations of any given study, this finding has consistently held up. The entirely predictable finding of variations within the charter sector also helpfully points us to more useful areas of inquiry. For example, how do well-resourced charters use those extra resources to extend or enrich learning time?

Advocates use research as a tool, and charter school research is inextricably tied to charter school policy. For this reason and others, we can expect that the heated debate will continue even while more research continues. In the meantime, those in charge of education policy need to make decisions about whether to encourage the expansion (or contraction) of charter schools, whether they should be funded at higher (or lower) levels, and whether they should be subjected to regulation (or further deregulation). Keep a close eye on the speedometer.


The National Education Policy Center (NEPC), which Kevin Welner directs, has received a grant from The Atlantic Philanthropies to study issues of access to charter schools. NEPC funding from the Ford Foundation and the Great Lakes Center for Education Research and Practice has also at times been used to commission work related to charter schools.

Read more