Earlier this summer, I released a study comparing the performance of California’s charter school networks with the amount of philanthropic grant funding they have received. The purpose was to find out if this model for replicating excellence was consistently effective. The answer, regrettably, was no.

But a new study we are releasing today finds that there is at least one place where better schools HAVE consistently scaled-up: Chile. Thanks to that nation’s public and private school choice program, chains of private schools have arisen, and they not only outperform the public schools, they also outperform the independent “mom-and-pop” private schools.

For anyone interested in replicating educational excellence, this study by a team of Chilean scholars is worth a look.

Here’s Where Better Schools HAVE Scaled Up… is a post from Cato @ Liberty - Cato Institute Blog

Charles Krauthammer’s latest column is titled “The Union-Owned Democrats.” In it, he recounts a litany of economically ruinous actions being pursued by unions around the country, from blocking free trade agreements to hobbling Boeing’s efforts to compete with Airbus. He writes that “unions need Democrats — who deliver quite faithfully,” and that “Democrats need unions.”

Like a hole in the head.

Yes, it’s been a politically and financially symbiotic relationship for many decades. Unions get rents, Democrats get elected. But, as I argue in a cover story for The American Spectator this month (now on-line: “A Less Perfect Union“), it can’t last.

The biggest unions of all are the public school employee unions—the AFT and the NEA—with well over 4 million members between them. As I point out in my Spectator piece, these unions have become too successful for their own good—and for the good of the Democratic party.

In their game of Monopoly with American kids and taxpayers they have created staggering bloat in public school employment (which has grown 10 times faster than student enrollment over the past 40 years), and they have wheedled total compensation packages worth $17,000 more per year than those of their private sector counterparts (who, according to most of the research, outperform them in the classroom).

But the union-led public school spending spree has nearly bankrupted states all over the country. If California’s public schools had just maintained the same level of efficiency they’d had in 1970 (not gotten better, as other fields have, just stagnated), it would turn the state’s $26 billion deficit hole into a surplus.

Americans are rapidly running out of money to pay for their states’ school monopolies, and they are rapidly introducing school choice bills (42 states have done so this year), to give families alternatives. But as families escape the highly unionized monopoly and send their kids to school in the largely non-unionized private sector, teachers union power will implode. And resentment at having been gored for so long by the now bankrupt and discredited system will focus on the party that fought to preserve it until the bitter end… Democrats.

In my Spectator piece, I explain why that would be a bad thing, and what Democrats could do to avoid that fate. “Public schooling” is just a tool, and an ineffective, unaffordable one at that. Public education is a set of goals and ideals that can be advanced much more effectively by other policy mechanisms. The sooner Democrats realize that, the less likely they are to be dragged to the bottom of the political sea by the sinking union-helmed school monopoly.

Are Unions Really Good for Democrats? is a post from Cato @ Liberty - Cato Institute Blog

Education scholar Jay Greene has a great new pamphlet called Why America Needs School Choice. Concise and very readable, it does a fine job of introducing the general public to the arguments and evidence in favor of market forces in education. In the process, it debunks six “canards” put forward by defenders of the status quo school monopoly.

Of particular value is Jay’s explanation of why existing “school choice” policies, while often producing positive results, have not yet transformed American education. He notes that these existing programs are hobbled by enrollment limits and regulations, and thus represent only dim shadows of what truly free and competitive education marketplaces would offer. I couldn’t agree more! In fact, the manifesto might more precisely be called Why America Needs a Competitive Education Marketplace, though perhaps that would have narrowed its appeal.

One minor quibble: On page 46, Jay writes that:

No private school choice program has been eliminated legislatively. Aside from a few adverse state court decisions, every choice victory is permanent, and every defeat is temporary.

The implication is that legislative and court action are the only avenues by which choice programs can be overturned. A third, public referendum, exists–and was responsible for the repeal of a Utah school voucher program in 2007. Would-be reformers should remember that lesson: unless the public understands and accepts the value of a policy, it may well overturn it before the first student ever participates. Manifestos like Jay’s are a good way to help spread that understanding.

A more significant problem with this particular passage is that it seems to imply that every “choice” program is a victory, and it asserts every victory is permanent. There is good reason to conclude that neither is the case.

The worldwide historical and modern evidence indicate that private schools will ultimately accept government funding no matter what strings are attached, and that such subsidized schools can consume the unsubsidized sector. This has happened in the Netherlands, for instance, which no longer has an unsubsidized private school sector after a century of government-funded private schooling. And since subsidized schools may not be operated for profit, it has no entrepreneurial chains of private schools.

So what happens if the subsidies eventually accumulate so much regulation that government-funded “private” schools become indistinguishable from today’s government schools? The result would be a move from the current 90% government monopoly to a 100% government monopoly. Not a victory at all, as the international evidence shows that the least regulated, most market-like education systems enjoy the greatest advantage over centrally planned school systems such as our own.

Last year, I ran a statistical analysis of the level of regulation imposed on private schools participating in voucher and education tax credit programs. I found that vouchers impose a large and statistically significant burden of extra regulation on private schools, whereas tax credits do not.  There are other issues with vouchers and charter schools as well. So all “choice” programs are not created equal.

Still, these concerns aside, Jay has written one of the best introductions to the case for educational freedom I’ve seen. I hope it gets a wide readership.

Jay Greene’s Great New Manifesto is a post from Cato @ Liberty - Cato Institute Blog

I like the nightlife, and I’ve got to boogie, so I’m pleased to hear of a new organization called DISCO: Democrats Impatient for School Choice Organization.

There are many ways to shake, shake, shake that education policy booty, however, and if DISCO really wants to be family friendly, they would be better off skipping the voucher element of their choreography.

The organization’s goal is to extend real school choice to low income families. A crucial element in achieving that goal is to ensure that parents, not influential lobby groups or entrenched interests, get to decide the kinds of education they can choose.  Based on both my review of the historical evidence and my recent regression study of modern school choice programs, vouchers are prone to regulatory proliferation. They centralize authority over what a voucher can buy, so that parents who need financial assistance cannot escape whatever limits the politically powerful wish to impose on them.

Tax credits are different. Scholarship donation tax credit programs, such as the one that already exists in Pennsylvania (and which the state House has voted 190 to 7 to expand) create a proliferation of different sources of financial assistance for low-income families. So if one of those sources decides to impose a particular set of rules on how the money is used, it doesn’t affect any of the others. Parents can choose to seek financial assistance from whichever scholarship granting organization most closely matches their own values and preferences, thereby preventing them from being forced into a particular set of choices.

I made this argument in a little more detail in Cato’s amicus brief in the ACSTO v. Winn case, in which the U.S. Supreme Court recently upheld Arizona’s scholarship donation tax credit program.

Family Friendly DISCO Moves is a post from Cato @ Liberty - Cato Institute Blog

I am often told that pointing out the serious shortcomings of government-funded school vouchers and the relative superiority of education tax credits is a case of “making the perfect the enemy of the good.”

It’s isn’t.

That is a misapplication of Voltaire’s famous aphorism. What the aphorism exhorts is that we not pursue an unattainable perfection when a good alternative is within reach. Education tax credits are not only attainable, they are usually easier to obtain than vouchers. Consider a recent example: Pennsylvania’s state House has voted 190 to 7 to expand its existing EITC tax credit program while the state Senate has been deadlocked for weeks looking for the bare minimum of votes to pass a voucher bill.

On top of that, it is dubious to cast vouchers as “the good” when they will expand the scope of compulsion of taxpayers to funding many new types of schooling to which they might well object, impose heavy new regulations on private schools (homogenizing the available “choices”), and more pervasively curtail direct payment by consumers in favor of third party government payment.

Even those who may not be fully convinced that vouchers are inferior should pause before trying to enact them in states that already have education tax credit programs with good growth prospects. Why make the dubious the enemy of the pretty darned good?

Don’t Let the Aphorism Be the Enemy of Thought is a post from Cato @ Liberty - Cato Institute Blog

Indiana Gov. Mitch Daniels signed an expansive new voucher law today. It’s a disaster for educational freedom. Read the full explanation here.

The voucher program has been widely praised as a momentous victory for school choice and Gov. Mitch Daniels on the brink of his long-awaited presidential campaign announcement. In reality, the voucher program is a tactical victory for highly constrained choice won at the price of a broad strategic defeat for educational freedom. This program will greatly expand state regulation of and authority over participating private schools.

In our efforts to expand educational choice across the country, we can’t lose sight of what makes that choice valuable: educational freedom and the diversity of choices it allows to develop. School choice is meaningless if all the choices are the same.

Just a teaser . . . ever heard of Chief Seattle? Private schools in Indiana will know him well if they take a voucher.

Read the piece for these and other shocking details!

Indiana Voucher Law a Defeat for Educational Freedom is a post from Cato @ Liberty - Cato Institute Blog

Charter schools are the hot new thing.

OK, they aren’t all that new. But many people who used to have blanket objections to any increase in school choice now support (some form of) charter schools. President Obama, and even AFT President Randi Weingarten, say they support “charter” schools. The guy who made Al Gore’s documentary, Sinners in the Hands of an Angry Planet, will soon release a film about choice and charter schools.

In the midst of the charter school hype, we need to remember that the private school system has been educating low-income kids longer, better, and more efficiently than charter schools. And charter schools are now sapping this tiny remaining redoubt of civil-society success and freedom in education.

Philanthropists who care about long-term, sustainable and dynamic improvement in the education system need to refocus. They need to pull back from the charter school mirage and invest in private school choice programs and private schools that are a proven, established success with at-risk children.

Fortunately, many philanthropists see the need to save private, often Catholic, schools for the poor:

Among his many achievements, [Robert W.] Wilson is the single largest benefactor of Catholic schools in the Archdiocese of New York. Since 2007, he has donated over $30 million to inner-city Catholic education. He is also an atheist… Wilson belongs to an elite order: non-Catholic donors who are the patron saints of inner-city Catholic schools.

Read the whole article by Christopher Levenick in Philanthropy magazine. Public charter schools are often better than the regular ones. But charter systems are a pale government reflection of the legacy and possibilities found in private education.

Foundations Need to Invest More in Private Education and Choice is a post from Cato @ Liberty - Cato Institute Blog

Tradeoffs are an incurable part of reality. Unfortunately, many school choice supporters like to believe that there are no tradeoffs between school choice policies; public and private school choice, targeted or restricted, big or small, voucher or tax credits, it’s all choice and it’s all good. But some good things are better than others. And most things have some mix of positive and negative effects.

Charter schools often provide a safer, better alternative to traditional public schools. That’s good. Charter schools also destroy private schools, decrease educational options, pull private-school students into the government education system and thereby add significant new costs to taxpayers. These are all very bad things. And they are not at all balanced by theories of long-term shifts in how citizens conceive of choice in education.

Here’s the latest on how government charter schools are killing what’s left of the private sector in education:

The number of students enrolled in these public, independently run schools has risen dramatically in this decade. Philadelphia school district officials estimate that 73 percent of the children now in charters came from district schools and 27 percent from other schools. That 27 percent amounts to about 9,000 students, and Catholic-school educators believe that most of them came from Catholic schools.

Charter schools have one distinct advantage over Catholic schools. They do not charge tuition.

Charters are NO substitute for private school choice. In fact, by destroying private schools, they seriously erode the total range of educational options.

We need to be clear-headed about this; charter school laws, in the absence of robust private school choice programs, destroy educational freedom and choice.

Absent private choice, charters are a long-term setback for education reform.

Charters Kill Private Schools and Add to Taxpayer Burden is a post from Cato @ Liberty - Cato Institute Blog

To the extent education policy commentary actually affects policy, it has the potential to do great good or great harm. Several recent commentaries in this field fall into the latter camp, and it’s important to understand why — so that we can avoid similar mistakes in future.

The one I’ll discuss here is this blog post by Matthew Yglesias, in which he draws broad conclusions about the functioning of education markets from a recent study of a tiny school choice program in Milwaukee as well as from some older unspecified research [for the latter, Yglesias linked here, but the body of that page doesn't discuss school choice]. The Milwaukee study is part of a vast literature. Over the past quarter century at least sixty-five studies have compared outcomes in public and private schools around the world, reporting 156 separate statistical findings.

The evidence of this literature is starkly one-sided. The vast preponderance of findings show private schools outperforming public schools after all the normal controls. What’s more, when we focus on the research comparing truly market-like systems to state-run school monopolies, the market advantage is found to be even more dramatic (see Figure 2 in the paper linked above). To draw policy opinions from a small, selective handful of those studies while ignoring the rest is policy malpractice, and it is dangerous to children.

Even the recent Milwaukee result described by Yglesias as a failure shows voucher students in private schools performing as well as public school students who receive roughly 50% more government funding. How is a program that produces similar academic results to the status quo at a much lower cost to taxpayers a failure? And what of the research suggesting that students in the Milwaukee voucher program graduate at higher rates than those in public schools?

More importantly from a long term policy perspective, how is a program limited to 20,000 or so children in a single city, being served almost entirely by non-profit entities, a test of market education? Would Apple have spent hundreds of millions developing the iPhone or the iPad if its market were limited to the same customer base? Of course not. The dynamism, diversity and innovation we have come to expect from competitive markets in other fields relies on the prospect of ultimately scaling up to serve mass audiences. Without the prospect of a large-scale return on investment, there is no incentive to invest in the first place.

Failures in Ed. Policy Analysis—Misunderstanding Milwaukee is a post from Cato @ Liberty - Cato Institute Blog

The Washington Post ran an incisive op-ed yesterday by Kelly Amis and Joseph Robert on the DC voucher program. As they noted, Sen. Joseph Lieberman is calling on the Senate to restore funding for the program which was terminated on a nearly party-line vote by Congress last December.

A few Democrats (Dianne Feinstein and Robert Byrd) have joined with Lieberman, but the rest of the party has apparently decided that producing better educational outcomes for poor kids at one quarter the cost of public schooling is not politically advantageous.

As Amis and Robert point out, private schools are far less unionized than the public school sector, so giving families an easier choice between the two will likely eat into to union revenues. And teachers union revenues end up disproportionately in the political piggy banks of Democrats.

The only thing that will change this situation is if voters decide they’ve had enough of such craven, Machiavellian politics, and vote the bums out. And some Democrats do indeed already seem to have had enough.

DC Vouchers, Democrats and Teachers Unions is a post from Cato @ Liberty - Cato Institute Blog

There’s a widespread belief that public schools are homogeneous and all inclusive while private schools are bastions of the elite. This was proven to be a myth decades ago by the renowned sociologist James Coleman, and as far as I know, that pattern of findings hasn’t changed in recent years.

Nevertheless, the myth continues. A new Fordham Institute paper provides a partial antidote, pointing out that quite a few public schools enroll virtually no low-income kids, making them bastions of the elite. Where the Fordham paper trips up a bit is in calling these elite public schools “private public schools.” As already noted above, private schools are, on average, better economically integrated than their government counterparts, so this phrase is exactly backwards and, as Sara Mead points out, is quite a slap in the face to the many private schools that do yeoman’s work serving large numbers of low-income students. Still, good to have folks taking note of these data.

The Paucity of Poor Kids in Many Public Schools is a post from Cato @ Liberty - Cato Institute Blog

On Tuesday, I criticized a new economic modeling paper (“Anti-Lemons”) purporting to show that unfettered education markets are bad and that government can fix them with the right regulations.

Andrew Gillen comes to the study’s defense, and I’m delighted that he’s taken the trouble to reflect on it rather than just saying “I like it.” But there are problems with his analysis. First, he faults me for dismissing the “Anti-Lemons” models for being based on false assumptions, citing Paul Krugman:

I am a strong believer in the importance of models, which are to our minds what spear-throwers were to stone age arms: they greatly extend the power and range of our insight. In particular, I have no sympathy for those people who criticize the unrealistic simplifications of model-builders.

Even if we put aside the fact that Paul Krugman is at times less reliable than the Daily Show website, there is an important difference between assumptions that are “unrealistically simplified” and those that are patently wrong. With the former, your model might still huck its intellectual spear somewhere in the general vicinity of the truth, with the latter, you’re just going to put your eye out.

“Anti-Lemons” is in the put-your-eye-out camp. Among other things, it assumes the productivity of all schools is equal. This is both totally false and highly germane — efficiency varies dramatically among schools, and private schools as a whole are consistently more efficient than government schools (as we will see below). Failing to recognize that reality will lead to incorrect results from the model, and this is just one of the false assumptions the paper adopts (see my previous post for others).

Second, Gillen writes that

going by Coulson’s numbers in figure 2 here, we would expect to find a positive impact of markets over government on achievement in slightly less than 2 out of 3 studies (with insignificant findings making up the majority of the others). If the case for free markets over government schools is really so clear cut (and I lean strongly in this direction), than why isn’t this 3 out of 3?

There are many plausible reasons for this result (lack of statistical power, omitted variable bias, other misspecification errors, etc.), but one is particularly worth raising here: government schools in many parts of the world spend several times as much per pupil as their private sector counterparts. This is true in most developing countries, from which a great deal of the inter-sectoral research hails. And when I looked at statewide data from Arizona in 2006 I found that government schools spend roughly 50 percent more than private schools. While it’s true that government school outcomes tend not to improve much as spending rises, the same cannot be said of private schools.

If this is true, you might ask, then wouldn’t the inter-sectoral research on school efficiency be more stark than the research on achievement (that fails to take spending levels into account)? The answer is yes. In fact, if you examine the efficiency bar in the same figure 2 cited by Gillen above, you will see that every single one of the efficiency comparisons between market and monopoly schools is significant and favors the market schools.

So, not only is the “Anti-Lemons” model useless, it is worse than useless: it seems to mislead even intelligent readers into believing that there is some mystery in the literature that needs to be solved by blindly waiving a spear around.

“Anti-Lemons” is neither Camelot, as I said yesterday, nor is it Sparta as Andrew implied. It’s the kid from Christmas Story who nearly puts his eye out by the cavalier application of a potentially powerful tool.

When they Give You “Anti-Lemons”… is a post from Cato @ Liberty - Cato Institute Blog

I wrote about this private school in South Carolina last year. The Voice for School Choice has a new video highlighting the great work of the Eagle Military Academy, which works with many kids the public schools cannot or will not educate.

There’s a lot of talk lately about the transformative power of some charter schools, and it’s easy to lose sight of the fact that many secular and religious private schools have been saving kids all along with no public funds and little or no recognition from the elite opinion class.

We need to open up choice to these schools as well, not just public charter schools that cannot provide the breadth and depth of experiences offered by private schools.

Public charter schools are no substitute for full school choice through education tax credits.

Charters No Substitute for Private Innovation is a post from Cato @ Liberty - Cato Institute Blog

HHS has finally released the second installment of its series of studies on the persistence of Head Start effects. Its finding (see page xiv): virtually all academic effects disappear by the end of 1st grade. There is only one positive statistically significant finding out of eleven academic outcomes measured, the size of that effect is minuscule by recognized standards (it’s half way between zero and what most social scientists consider “small”), and the confidence in the finding is low by recognized standards. (Many authors would categorize it as “insignificant” rather than “significant” — it’s only significant at a 90% confidence interval, not the more common 95% confidence interval).

We have spent more than $100 billion on the program to date (ballpark estimate from Table 375 here) and HHS’s own research shows that its results diminish to essentially nothing by the end of the first grade.

There are other government education programs whose effects actually grow substantially over time, and that are comparatively economical. Consider the federal DC voucher program. Just a year or two after switching from public to private schools, the effect of the private schooling was not big enough to rise to the level of statistical significance. But by their third year in private schools, the evidence was clear that voucher-receiving students were reading more than two grade levels above a randomized control group that stayed in public schools.  This program, as I’ve previously documented, costs 1/4 as much per pupil as DC spends on public education: about $6,600 vs. $28,000.

But Congress, and particularly Democrats, have defunded the DC voucher program while raising spending on Head Start. President Obama is at the forefront of this travesty. If you weren’t already jaded and disgusted by education politics and its domination by employee unions opposed to educational choice, start now.

Head Start’s Impact Evanescent — HHS Study is a post from Cato @ Liberty - Cato Institute Blog

The latest fiscal impact review of Arizona’s scholarship tax credit programs estimates that they saved between $44 million and $186 million last year.  The programs offer individuals and businesses dollar-for-dollar tax credits if they make donations to non-profit K-12 scholarship-granting organizations. Those organizations, in turn, provide private school tuition assistance.

This is much higher than the savings estimate offered by the Arizona Republic last month, as the AZ Republic story linked above is quick to point out. I deal with the reasons for the discrepancy below, but first, here’s the crucial fact that the Republic has missed yet again: if the tax credit programs were significantly expanded, such as by raising the donation caps, the state would undeniably save many hundreds of millions of dollars annually. In fact, if the share of AZ schoolchildren participating in the program rose to just 40 percent, taxpayers would save billions of dollars a year – even if the size of the individual scholarships had to triple to achieve that result.

The Republic’s failure to report that inescapable and rather important fact does it no credit.

Now, on to the reason for the discrepancy in savings numbers. The body of the story hints at it: the Republic’s estimate assumed that private school enrollment would have been flat or increasing without the tax credit program, while the latest estimate does not.

As I pointed out at the time, the Republic’s assumption is demonstrably mistaken. Official AZ statistics show that enrollment in private schools peaked before the tax credit program had gotten under way, and had begun to decline as a result of rapid growth in the (tuition-free) charter school sector. So the Republic’s savings estimate was almost certainly too low.

As the author of the latest study admits, his assumptions about the true number of students who have migrated to private schools as a result of the program are speculative, but at least they are reasonable and not obviously erroneous, as the Republic’s were. In any event, the savings from a much larger migration to the private sector are not in doubt.

K-12 Education Tax Credits Save Millions is a post from Cato @ Liberty - Cato Institute Blog

We’ve been writing a fair amount over the last several months about increasing support for school choice among members of the Democratic Party. The focus has typically been on legislators, but a new report from the Center for Education Reform give a glimpse into possible widespread support among private-schooling Dems and Dem donors in Washington, DC.

The Trustees delves into the political affiliations of board of trustee members of the “ten most prestigious private schools that support the  D.C. Opportunity Scholarship Program.” Based on trustees’ total donation amounts to the two major presidential candidates in 2008, or to candidates, party committees, and parties themselves, the report suggests that trustees lean Democratic by a ratio of roughly 9 to 1.

Importantly, only about 37 percent of trustees were found to have made any contributions, so the 9-to-1 ratio doesn’t necessarily mean that trustees overall are similarly skewed. In addition, the underlying assumption seems to be that if the schools participate in the voucher program their trustees support school choice, which doesn’t necessarily follow. A trustee may very well think a school should take some voucher kids but also think the program ought not to exist. And, of course, trustees almost certainly don’t all agree one way or the other.

Those things said, this is yet more evidence supporting an increasingly inescapable conclusion: Democrats — who have historically opposed school choice much more so than Republicans — are finding that they just can’t do it anymore. There is no justification for consigning kids to awful schools.

Of course, members of both parties — or no party at all — who support only small, hamstrung programs still have a lot of thinking to do…

As The Dems Turn (To School Choice) is a post from Cato @ Liberty - Cato Institute Blog

An interesting story in the San Francisco Chronicle highlighting how private schools are outcompeting both radical madrasas and government schools in the hearts and minds of a great many Pakistanis. Sounds a little bit like this.

How to Flunk the Taliban is a post from Cato @ Liberty - Cato Institute Blog

In a response to my post this morning, Charles Murray remains unconvinced that changes to our school system could result in dramatic improvements in educational outcomes.

He asks to see the scholarly study showing that a school has miraculously boosted achievement above the norm. In one way, this hurdle is too low, and in another it’s too high.

If we could only point to a single study of a single school, it wouldn’t instill much confidence in the generalizability of the phenomenon. A consistent pattern of scholarly results is necessary for that. On the other hand, asking for “miraculous” improvement is a needlessly high standard. My disagreement is with Murray’s earlier, lower threshold claim that:  ”reforms of the schools can never do more than produce score improvements at the margin.”

Let’s call a marginal improvement an increase of less than .15  standard deviations above the current mean (typically considered a “small” effect in the social sciences). Taking that as our litmus test, is there a consistent pattern of scholarly evidence that better school system design can boost achievement by more than .15 standard deviations? Yes.

That pattern is presented in the figure above, drawn from my recent review of the global econometric literature comparing educational outcomes across different types of school systems. The figure relates the number of statistically significant findings favoring free education markets over state school monopolies (in white), significant findings of the reverse (in light grey), and insignificant findings (in dark grey). Markets beat monopolies by a ratio of 15 significant findings to 1, across the seven educational measures for which data are available.

While a few of these findings have small effect sizes, many are above .15 standard deviations — some of them well above it. A paper by Tooley, Dixon, Bao, and Merrifield (under consideration by the journal Economics of Education Review), for instance, finds that in Nigeria private schools outscore public schools by double that amount, after controls, while ”in Delhi and Hyderabad private unrecognized schools top state-run schools in math instruction by about 2/3 of a standard deviation.” A recent randomized assignment study of the DC voucher program finds that voucher students who’ve been in the program for three years are reading two grade levels ahead of their public school peers (.42 std deviations), though the average voucher is worth only a quarter of what DC spends per pupil on public k-12 education.

These are more than marginal improvements, and they are part of a consistent pattern. That pattern strongly suggests that moving from our current monopoly school system to a free and competitive education marketplace would shift the bell curve of academic achievement significantly to the right, raising the mean achievement substantially above its current level.

No one should be surprised by that. Imagine how far the bell curve for median income across modern nations would shift to the left if all free markets were supplanted with centrally planned monopolies such as have ruined the economies of Cuba, North Korea, and until recently many other nations.

Throwdown with Charles Murray is a post from Cato @ Liberty - Cato Institute Blog

Bruce Baker, author of the study of private school spending about which I blogged yesterday, has responded to my critique. Dr. Baker thinks I should “learn to read.”

He takes special exception to my statement that he “makes no serious attempt to determine the extent of the bias [in his chosen sample of private schools], or to control for it.” Baker then points to the following one paragraph discussion in his 51 page paper that deals with sample bias, which I reproduce here in full [the corresponding table appears on a later page]:

The representativeness of the sample analyzed here can be roughly considered by comparing the pupil-teacher ratios to known national averages. For CAS and independent schools, the pupil-teacher ratio is similar between sample and national (see Figure 21, later in this report). Hebrew/Jewish day schools for which financial data were available had somewhat smaller ratios (suggesting smaller class sizes) than all Hebrew/Jewish day schools, indicating that the mean estimated expenditures for this group might be high. The differential, in the same direction, was even larger for the small group of Catholic schools for which financial data were available. For Montessori schools, however, ratios in the schools for which financial data were available were higher than for the group as a whole, suggesting that estimated mean expenditures might be low.

Even with my admittedly imperfect reading ability, I was able to navigate this paragraph. I did not consider it a serious attempt at dealing with the sample’s selection bias. I still don’t. In fact, it entirely misses the main source of bias. That bias does not stem chiefly from class size differences, it stems from the fact that religious schools need not file spending data with the IRS, and that the relatively few that do file IRS Form 990 (0.5% of Catholic schools!) have a very good reason for doing so: they’re trying harder to raise money from donors.  This is not just my own analysis, but also the analysis of a knowledgeable source within Guidestar (the organization from which Baker obtained the data), whose name and contact information I will share with Dr. Baker off-line if he would like to follow-up.

Obviously, schools that are trying harder to raise non-tuition revenue are likely to… raise more non-tuition revenue. That is the 800 pound flaming pink chihuahua in the middle of this dataset. According to the NCES, 80 percent of private school students are enrolled in religious schools (see p. 7), and this sample is extremely likely to suffer upward bias on spending by that overwhelming majority of private schools. They may spend the extra money on facilities, salaries, equipment, field trips, materials, or any number of other things apart from, or in addition to, smaller classes.

Baker’s study does not address this source of bias, and so can tell us nothing reliable about religious schools, or private schools in general, either nationally or in the regions it identifies. The only thing that the study tells us with any degree of confidence is that elite independent private schools, which make up a small share of the private education marketplace, are expensive. An uncontroversial finding.

It is surprising to me that this seemingly obvious point was also missed by several other scholars whose names appear in the frontmatter of the paper. This is yet another reminder to journalists: when you get a new and interesting paper, send it to a few other experts for comment (embargoed if you like) before writing it up. Doing so will usually lead to a much more interesting, and accurate, story.

Author of the Private School Spending Study Responds is a post from Cato @ Liberty - Cato Institute Blog

I know, it’s a bit of a dog-bites-man headline, but bear with me. A new study by a Rutgers University ed. professor purports to tell us about “Private Schooling in the U.S.: Expenditures, Supply, and Policy Implications.” The trouble is, the study presents no data that are representative of private schooling in the U.S.

Author and ed school professor Bruce Baker analyzed per pupil expenditures of private schools that had registered with Guidestar.org. Based on its mission statement, Guidestar is a service brings together charities seeking donations with would-be donors, in an effort to encourage philanthropy. Only a fraction of the nation’s private schools participate, and they are self-selected into that group. It is reasonable to think that the schools that self-select into Guidestar are the ones most avidly seeking donations. According to a PowerPoint presentation on Guidestar’s site, its top five types of users are:

• Non-Profit Development Directors
• Non-Profit Fundraising Directors
• Grant Writers
• Foundation Grants Administrators and Donor Services Managers
• Corporate Foundation Giving Program Managers

Quite possibly, the private schools most actively seeking non-tuition revenue are the ones… receiving the most non-tuition revenue. So not only is the Guidestar population of private schools not randomly selected, and non-representative of private schools nationally, there is reason to believe it is biased in the direction that its author and funders favor.

This would be bad enough, but it gets worse. The author makes no serious attempt to determine the extent of the bias, or to control for it. In fact, he consciously makes it worse: he choses to eliminate from consideration any private schools reporting revenues or expenditures under $500,000, thereby excluding smaller, less expensive schools.

I have literally NEVER seen a serious academic study that starts from a sample that is known to be biased in the direction favored by its funders and then consciously makes matters worse by actively skewing it even further!

An example of the kind of analysis that is supposed to accompany the presentation of a non-random sample to ascertain extent and direction of bias appears in my own 2006 study of Arizona private schools, available here. I dedicate five pages (beginning on page 14) to an assessment of whether and to what extent my survey respondents differed from the universe of all Arizona private schools. Significant effort was expended on that section of the study, because it is both necessary and expected. I was disappointed, though not surprised, by the absence of such a section in the Baker study.

Not only can the Baker study not tell you how much U.S. private schools really spend, it seems to have a little difficulty getting the public school spending figures right, too. For instance, there is a line on page 42 implying that DC public schools were spending $14,000 in 2007.  Federally-reported data show that DC was already spending over $18,000 per pupil in 2005-06. And I’ve shown that it spent $28,000/pupil in 2008-09.

Finally, did I mention that Baker’s study was funded by the NEA-bankrolled “Great Lakes Center for Education Research and Practice”? As Ed Sector pointed out a couple of years ago: “The Great Lakes Center and the NEA’s Michigan affiliate are also linked on a personal level: [the Center's director] Teri Battaglieri is married to Michigan Education Association Executive Director Lou Battaglieri.”

***

Update:  Note that the reason Guidestar only has financial information for a small fraction of the nation’s private schools is that the vast majority of U.S. private schools are religious, and religious schools are not required to file IRS Form 990 (from which Guidestar gets its financial data). The religious private schools that do file Form 990 are thus a small self-selected group that is presumably seeking to maximize its revenue from charitable donations, and hence very likely biased toward higher spending schools.

Union-Funded Study Says Private Schools Expensive! is a post from Cato @ Liberty - Cato Institute Blog