Category Archives: International Comparisons

Liberia is relinquishing. Is it working? 1st year results are in.

Screen Shot 2017-10-02 at 8.34.53 PM

Over the past few years, Liberia has embarked on an ambitious project to partner with non-governmental school networks.

Even more daring: Liberia’s political leadership is parterning with foreign school operators, some of which are for-profit.

Imagine for a second if, after Katrina, New Orleans political leaders had decided to partner with school operators from Singapore, Finland, and Shanghai.

In Liberia, numerous short-term and long-term risks abound – as do extremely high-potential upsides.

Partnership schools achieved .18 SD gains in one year 

Whatever one thinks of Liberia’s strategy, kudos to them for partnering with school networks in a manner that allowed for randomized control trials. Because schools were randomly selected for partnership, we can get a better understanding on whether or not the providers are delving a better education.

In aggregate, the first year effects were large: students in partnership schools scored 0.18 standard deviations higher in English and 0.18 standard deviations higher in mathematics than students in regular public schools. The authors note: “while starting from a very low level by international standards, this is the equivalent of 0.56 additional years of schooling for English and 0.66 additional years of schooling for math.”

Also, teachers are showing up more often: “teachers in partnership schools were 20 percentage points more likely to be in school during a random spot check (from a base of 40% in control schools).”

And teachers are teaching: “…16 percentage points more likely to be engaged in instruction during class time (from a base of 32% in control schools).”

Results varied by provider

The highest performing operators delivered ~.3 effects!: the Youth Movement for Collective Action (YMCA), Rising Academies, Bridge International Academies, and Street Child.

Second tier (very solid .15 effects): BRAC and More than Me.

Third tier (no effect): Omega and Stella Maris.

Screen Shot 2017-10-02 at 9.13.20 PM

Students receiving 2X learning time

This was incredible to me: “students in partnership schools spent twice as much time learning each week, when taking into account reduced absenteeism, increased time-on-task, and longer school days.”

Costs running a bit high (but to be expected in start-up)

The authors note that operators were spending more per-pupil than traditional schools; while this is a warning sign, I don’t read much into it now, as start-up efforts generally run higher and than smooth out. The exact same pattern happened in New Orleans.

What is the impact on traditional educators and schools?

As in the United States, non-governmental school operator growth impacts the traditional system, which has both programmatic and political consequences.

In an odd twist, the government contracts limited the class sizes of networks, which forced some operators to turn away students who then had to find other schools.

Operators also fired existing teachers, which presumably benefited children but caused adult hardship and risks political blowback.

I predict that these issues will only increase in salience. They require solutions that are both programmatic (government regulation of student equity issues) and political (ensuring that adult incumbents don’t derail positive efforts).

Teacher supply issues may get worse

The researchers note that to the extent that operators were able to recruit better teachers – and that the supply of teachers does not change – operators will be unable to scale and achieve the same effects.

In New Orleans we faced the same issue: we failed to grow high-quality teacher pipelines at the same pace we grew operators, and this caused operator growing pains midway through their scaling plans.

I hope Liberia gets ahead of this.

Is it worth it?

The perennial (and reasonable) question asked in such efforts is always: is it worth it? Is the disruption to families and educators worth the gain?

This question was asked a lot in New Orleans. I (as with the majority of New Orleanians) believe that it was worth it in New Orleans.

But I do think the Liberia case is more complicated, as it involves issues of national institutions and sovereignty.

There are numerous risks to outsourcing school operations to international organizations.

What if you end up in a conflict with the home nation(s) of large operators? What if these operators inculcate undesirable foreign values to your culture? What if the outsourcing of your educational operations slows down the overall maturation of your civil society?

These are hard questions.

My guess is that it is worth it, in that the gains of having a much better educated populace are worth the trade-offs of relying on foreign operators.

But I am not an expert in international development and I have not studied the issue enough to have strong opinions.

All that being said, all involved deserve our praise: the government is trying hard to serve their citizens, the school networks are serving students in extremely difficult situations, and the students themselves are getting smarter.

Here’s hoping the positive results continue.

Catch-up Reform vs. Innovation Reform…. What the United States Can Learn from Other Nations

sachs

I just read this Tyler Cowen interview of Jeffrey Sachs.

It is well worth reading, and I’m excited for the Cowen interview series to continue.

Sachs on Catch-up Reform, Innovation, and Differential Diagnosis 

Two excerpts from the interview.

First, Sachs covers the two drivers of international economic growth: innovation and catch-up.

…when you look at development, there are at least two fundamental drivers, not just one. The one that they talk about is innovation, and innovation as being a fundamental driver of growth. There’s a lot of truth to that in the history of the world.

But there’s a second fundamental aspect when we look out in the world and say, “Who’s doing well? Who’s doing badly? Why?” and so forth. That’s what is sometimes called “catching up.” The phenomenon of catching up is very different from the phenomenon of forging ahead at the front of the technology horizon.

When you take that simple distinction, it helps to explain a lot of the post-1960 question that you’re asking. The most successful countries in the world in the last 50 years have been basically the East Asian economies and Southeast Asian economies.

Sach’s main point is that growing when you’re at the head, middle, or back of the pack all require different strategies. Moreover, it’s not really helpful to compare growth rates of countries that are at the frontier of innovation and those that are simply executing catch-up growth.

Sach’s also presses hard on differential diagnosis of problems rather than one-size-fits-all solutions:

That’s what I mean by differential diagnosis. Why it’s so annoying to me, the one explanation fits all viewpoints. Because now I’ve seen a lot of places, a lot of crises, a lot of challenges. One of the things that I discovered was how poor our profession is at times in having that sense that the problem that you saw over there is not the same as the problem that you’re seeing here.

Education Reform: What Catch-Up Growth Can We Achieve? 

The United States is roughly in the middle of the pack when it comes to international rankings of educational attainment.

As such, there may be some catch-up growth we can undertake. However, when figuring out what best practices to adopt and which to avoid, we need to understand how our own situation may be different than other countries.

I view (1) implementing rigorous standards and assessments and (2) increasing incoming teacher quality to be the two highest potential catch-up strategies. Many (though not all) of the world’s top performing educational systems excel in these areas (admittedly, causation is difficult to prove).

In some form or another, we’ve begun to make headways in both these areas: assessment rigor is rising and incoming teachers are achieving at higher levels.

I’m less bullish on two other potential catch-up strategies: bureaucracy improvement and a culture of extremely hardwork.

The United States is an incredibly large nation; it consists of many levels of government; and it suffers from overly politicized and often ineffectual government bureaucracies. I don’t see us becoming Singapore anytime soon. Additionally, unlike some of the top-performing Asian nations (South Korea, Japan), we do not have a national culture that reveres education and long hours of studying.

Rather, our nation’s core strengths are more around entrepreneurship, problem solving, and (at least at one time) pragmatism. As such, I don’t think it makes sense to spend a lot of resources trying to optimize the thousands of school board / districts or attempting to change our national culture.

We Don’t Need to Limit Ourselves to Catch-up Growth

Given our nation’s resources and talent, we also don’t need to simply confine ourselves to catch-up growth strategies. We should innovate as well.

I think we’re well positioned to innovate in the following areas:

Governance: Given the low quality of our bureaucracies, and our national culture of entrepreneurship, I think we can be a leader in alternative governance structures. Charter schools, vouchers, course choice, Tiny Schools, etc. – many of these are delivering results, and others hold promise.

Technology: In many industries, the United States has been a world leader in technological advancement. Ideally, we will be able to translate this progress into gains in educational technology.

Non-Elite Higher Education: The United States has been an international leader in higher education for decades, but this is mostly driven by our top research universities. I think that a combination of governance and technology innovations can increase the quality of our non-elite  universities and vocational programs.

Of course, both governance and higher education face heavy regulations and strong incumbents. So innovation may be difficult to come by.

But, all things considered, I’m optimistic on these fronts.

American Millennials are Dumber than Other OECD Millennials

Robert Pondiscio recently blogged on this report AMERICA’S SKILLS CHALLENGE: Millennials and the Future.

Both are worth reading.

Basically, just about anyway you cut it, America’s millennial (ages 16-34) do worse than most OECD countries on skills tests; specifically:

1. As a nation, we do worse as a whole when compared to other OECD nations.

2. Our best millennials do worse than the best millennial of other nations.

3. Our lowest performing millennials do worse than the lowest performing millennials of other nations.

4. Our native born millennials do worse than the native born millennials of other nations.

5. Our gaps between highest and lowest performing millennials are amongst the highest in the OECD.

6. Perhaps most distressing, this generation is performing worse than previous American generations.

7. Also, we spend more on education than just about any nation in the world.

Reflections

The Link Between Test Performance and Economic Growth

America has always done mediocre on international assessments, yet we’re the richest large nation in the world. Clearly, some combination of our culture, policies, and resources continue to deliver significant wealth.

Of course, this is not a controlled experiment. Perhaps if we were betted educated we’d be even richer. And perhaps our other competitive advantages will erode due to globalization and technology.

In a World of Limited Resources, Where Do You Invest?

Even if you believe that raising academic achievement would increase economic growth, this does not mean that raising academic achievement is the most efficient way to increase economic growth.

For example, if you had a billion dollars to give, you might spend it on immigration reform rather than education, with the idea that more immigrants = more entrepreneurs = more wealth creating companies.

Just because you identify a problem, it doesn’t mean that it’s the problem you should be devoting marginal resources to solving.

In this sense, you could argue that we should be cutting spending from education (since we are paying so much for such mediocre outcomes) and put the funds in areas that are more likely to deliver better societal outcomes.

If You Want to Make Things Better, What Do You Do?

Regardless of where you invest or cut marginal resources, we’re still going to be delivering publicly funded education, so it’s definitely worth trying to make it better. Over the past few years, I’ve been fairly consistent in my recommendations for improving American education: (1) devolve operational control of schools to non-profits (2) increase selectivity and training of new teachers (3) make long-term bets on technology (4) restructure grades 11-16 to better transition students into gainful employment (5) increase wage subsidies and the EITC to reduce poverty.

Culture

That being said, there will always be a ceiling to what education reform and poverty alleviation can accomplish.

Ultimately, we cannot outperform who we are. We study less than the top Asian nations. And we kill each other more often than most European nations.

But there is also this:

Screen Shot 2015-03-02 at 8.31.29 PM

Nearly all of the top 10 companies in the world (measured by market value) are located in the United States.

Somethings we do well.

Which begs two questions:

Will we continue to do well what we currently do well?

Or will our weak academic outcomes catch-up with us?

It’s difficult to tell.