Category Archives: Governance

Is San Francisco progressive?

San Francisco is a thriving city and I love living here. It nearly has it all: great people, a vibrant economy, and natural beauty in all directions.

But there is one thing San Francisco does’t have: a public education system that does right by low-income African American and Latino students.

One of the wealthiest and most innovative cities in the world can’t teach low-income kids to read, write, and do math.

Nearly every other city in California performs better than San Francisco in educating low-income students, and it’s not like most of the cities are knocking it out of the park.

And the worst part of it all is that the fix is not too hard. Within a decade, I bet San Francisco could be one of the highest performing urban school systems in the country.

But I’m skeptical that will occur. The people who control the system do not want it to change.

Traditional Schools Harm Low-Income Students in San Francisco 

San Francisco is one of the richest cities in the world. But when it comes to serving low-income African-American students, the city is trounced by other cities across the state.

recent report from Innovate Public Schools provides the details.

Screen Shot 2017-11-10 at 8.32.36 PM

Low income Latino students don’t do much better.

Screen Shot 2017-11-10 at 8.33.54 PM

Charter Schools Help Low-Income Students in San Francisco 

Is there something about low-income kids in San Francisco that makes them impossible to educate?

No.

Charter schools in San Francisco are doing a much better job educating low-income students.

Screen Shot 2017-11-10 at 9.05.51 PM

More rigorous research (quasi-experimental methadology that controls for socioeconomic variables) has also found that charter schools in the Bay Area dramatically outperform the traditional system. This study found positive .2 standard deviation annual effects in math and .1 effects in reading.

It Could Get Better But It Probably Won’t

Cities like Denver, Washington D.C., and New Orleans are proving that there’s a better way to do public education.

Denver is continuing to deliver results over ten years after its reforms began. Washington D.C. has seen its scores skyrocket on the Nation’s Assessment of Educational Progress. New Orleans achieved amongst the greatest educational gains that the nation has recently seen.

Our team has the privilege of working with cities to make their educational systems better, but I spend most of my time on the road because the San Francisco Unified School Board doesn’t have any interest in the reforms that could make the city’s public schools great.

Unlike the aforementioned cities, San Francisco Unified is extremely unwelcoming to high-quality charter schools.

Instead of partnering with high-quality non-profit charter schools, the school district continues to insist that it will fix itself.

But this will not happen. And low-income kids will keep getting screwed.

So no, San Francisco is not progressive. At least not when it comes to public education.

SaveSaveSaveSaveSaveSave

Liberia is relinquishing. Is it working? 1st year results are in.

Screen Shot 2017-10-02 at 8.34.53 PM

Over the past few years, Liberia has embarked on an ambitious project to partner with non-governmental school networks.

Even more daring: Liberia’s political leadership is parterning with foreign school operators, some of which are for-profit.

Imagine for a second if, after Katrina, New Orleans political leaders had decided to partner with school operators from Singapore, Finland, and Shanghai.

In Liberia, numerous short-term and long-term risks abound – as do extremely high-potential upsides.

Partnership schools achieved .18 SD gains in one year 

Whatever one thinks of Liberia’s strategy, kudos to them for partnering with school networks in a manner that allowed for randomized control trials. Because schools were randomly selected for partnership, we can get a better understanding on whether or not the providers are delving a better education.

In aggregate, the first year effects were large: students in partnership schools scored 0.18 standard deviations higher in English and 0.18 standard deviations higher in mathematics than students in regular public schools. The authors note: “while starting from a very low level by international standards, this is the equivalent of 0.56 additional years of schooling for English and 0.66 additional years of schooling for math.”

Also, teachers are showing up more often: “teachers in partnership schools were 20 percentage points more likely to be in school during a random spot check (from a base of 40% in control schools).”

And teachers are teaching: “…16 percentage points more likely to be engaged in instruction during class time (from a base of 32% in control schools).”

Results varied by provider

The highest performing operators delivered ~.3 effects!: the Youth Movement for Collective Action (YMCA), Rising Academies, Bridge International Academies, and Street Child.

Second tier (very solid .15 effects): BRAC and More than Me.

Third tier (no effect): Omega and Stella Maris.

Screen Shot 2017-10-02 at 9.13.20 PM

Students receiving 2X learning time

This was incredible to me: “students in partnership schools spent twice as much time learning each week, when taking into account reduced absenteeism, increased time-on-task, and longer school days.”

Costs running a bit high (but to be expected in start-up)

The authors note that operators were spending more per-pupil than traditional schools; while this is a warning sign, I don’t read much into it now, as start-up efforts generally run higher and than smooth out. The exact same pattern happened in New Orleans.

What is the impact on traditional educators and schools?

As in the United States, non-governmental school operator growth impacts the traditional system, which has both programmatic and political consequences.

In an odd twist, the government contracts limited the class sizes of networks, which forced some operators to turn away students who then had to find other schools.

Operators also fired existing teachers, which presumably benefited children but caused adult hardship and risks political blowback.

I predict that these issues will only increase in salience. They require solutions that are both programmatic (government regulation of student equity issues) and political (ensuring that adult incumbents don’t derail positive efforts).

Teacher supply issues may get worse

The researchers note that to the extent that operators were able to recruit better teachers – and that the supply of teachers does not change – operators will be unable to scale and achieve the same effects.

In New Orleans we faced the same issue: we failed to grow high-quality teacher pipelines at the same pace we grew operators, and this caused operator growing pains midway through their scaling plans.

I hope Liberia gets ahead of this.

Is it worth it?

The perennial (and reasonable) question asked in such efforts is always: is it worth it? Is the disruption to families and educators worth the gain?

This question was asked a lot in New Orleans. I (as with the majority of New Orleanians) believe that it was worth it in New Orleans.

But I do think the Liberia case is more complicated, as it involves issues of national institutions and sovereignty.

There are numerous risks to outsourcing school operations to international organizations.

What if you end up in a conflict with the home nation(s) of large operators? What if these operators inculcate undesirable foreign values to your culture? What if the outsourcing of your educational operations slows down the overall maturation of your civil society?

These are hard questions.

My guess is that it is worth it, in that the gains of having a much better educated populace are worth the trade-offs of relying on foreign operators.

But I am not an expert in international development and I have not studied the issue enough to have strong opinions.

All that being said, all involved deserve our praise: the government is trying hard to serve their citizens, the school networks are serving students in extremely difficult situations, and the students themselves are getting smarter.

Here’s hoping the positive results continue.

If you want to be a superintendent build a school district

I cross paths with many people who want to become a superintendent of a large city school district.

Most of these people feel that this is the ultimate leadership position when it comes to serving children in need.

When I ask why, they say: “that’s where the kids are.”

I usually say: “this is not an immutable condition.”

Charter leaders are building some of the largest school districts in the country 

The most scaled high-performing charter network, KIPP, serves nearly a 100,000 students.

Right now, KIPP is around the 40th biggest school district in the country.

I bet within a decade it will be in the top 10 biggest school districts in the country.

A few other CMOs are on track to serve 100,000 students within the decade as well.

Within 10-15 years, a quarter of the top 25 biggest school districts in the country may be charter networks.

You can spend 15 years building an amazing school district or 3 years trying to fix a broken one 

KIPP is about 20 years old. Given all we know now (thanks in part to KIPP and other early CMOs), new charter founders should be able to hit the 100,000 student mark in less time.

With a bunch of hard and a bit of luck, the best entrepreneurs in the country should be able to replicate KIPP’s success and build 100,000 student CMOs in 10-15 years.

Compare this to being a superintendent: you inherit a struggling school district and have on average about 2-4 years to try and make it better before you are pushed out.

A few incredible superintendents succeed in making a dent, but most don’t.

As a charter founder, so much more of your potential for impact is in your control. And if you get results your board generally won’t fire you; rather, they’ll encourage you to serve more students.

There are about 10-15 million students attending public school and living in poverty

If the high-performing charter community could build 100 school districts that each served 100K students, we could provide nearly all students living in poverty with a great public education.

Are there a 100 people (or teams) in this country that can build a 100K school district? I don’t know.

Leading a major charter network is an incredibly difficult job. We need to do all we can be doing to make it as sustainable as possible.

The future of educational opportunity in this country might depend on it.

[thanks to James Cryan and Norman Atkins for inspiring this post]

Does it matter if charter schools make traditional schools better?

A new study found that traditional schools in New York City improved when charter schools opened up in the near vicinity. See this Chalkbeat article for coverage.

The effects were small for neighborhood impact (traditional schools improved +.02 SDs) and larger for co-locations (traditional schools improved +.06-.09 SDs).

What is the value of charter schools?

Charter schools could help students in two ways: (1) directly serving students and (2) increasing the performance of other schools.

I don’t believe that #2 must be true in order to support charter schools. The very fact that charter schools help the students they serve could be enough to warrant support.

An even more complicated question: what if charter schools increased the performance of the students they served but decreased the performance of traditional schools?

If, like me, you believed non-profit operation of schools should overtime supplant direct government operation of schools, then you still might support the expansion of charter schools. The negative impact of charter growth on traditional schools, while painful, could be a price worth paying if more children were benefitted by the new system over the long-haul.

Be careful how you justify your opinions 

The reason I make this point is that I don’t think we should tie the value of charter schools to their impact on nearby traditional schools.

While this impact is something we should understand – and if in some instances there are negative impacts we should we work to reduce them – ultimately, the fact that their might be a better way to do public education should be our Northstar.

Building the new system is more important to children than protecting the old system.

But hopefully we continue to find more evidence of win / win

That being said, this study is good news: it’s pretty amazing that New York City has grown a high-quality charter sector and that this sector has helped improved traditional schools.

Hopefully future studies will show the same.

But they might not. And expanding great public charter schools might still be the best thing for children.

So we should be cautious in justifying the existence of charter schools in how they impact traditional schools.

Ultimately, their highest and best use is likely to be in the creation of a better way to do public schooling at scale.

Roland Fryer and the Root Cause of Good Management

Screen Shot 2017-05-30 at 3.44.45 PM

Roland Fryer is one of the top education researchers in the country. His research is always thought provoking and whenever we talk I learn something.

If there’s one area Roland and I may disagree on, it’s the potential for school districts to sustainably adopt the best practices of charter schools (which Roland has been instrumental in helping us understand).

This issue is of course wrapped up in the bigger question: will the greatest value of charter schools be the birth of  innovative practices or the scaling of a better governance model?

I. Roland’s New Research: MGMT Matters

Roland just came out with a fascinating study on the importance of effective principal management.

The experimental research project was set in Houston and provided principal management training (much of it borrowed from Paul Bambrick-Santoyo of Uncommon Schools) to a treatment group of school district principals.

The researchers found:

Overall, the estimates suggest that management training was effective in year one – increasing efficiency approximately 7% — but produced precisely estimated zeros in year two. Pooling the two years produces marginally significant results that fall on the other side of significance with more conservative standard errors. Management training tends to be more effective with more flexible, stable and higher human capital principals and teachers. The most robust partitions of the data are whether a principal was employed for both years of the experiment and fidelity of implementation of the management training.

In sum: they found impressive effects with talented principals who stayed in the job for two years but no effects overall due to principal turnover and too many low human capital leaders.

II. Why Did Fryer Need to Conduct an Experiment in Houston?

Data driven instruction and teacher feedback, which were key to the intervention, are not new ideas. Bambrick wrote Leveraged Leadership in 2012. And he surely wasn’t the first to implement these management practices.

So why did Fryer need to construct an experiment to apply these sound management practices in Houston?

Why wasn’t the Houston school district applying these techniques already?

As it happens, some other researchers (Nicholas Bloom, Erik Brynjolfsson, Lucia Foster, Ron Jarmin, Megha Patnaik, Itay Saporta Eksten, John Van Reenen) just published a paper on this very subject – with the aim of trying to understand the root causes of good management practices.

III. What are the Root Causes of Good Management Practices?

It’s hard to do a controlled experiment on management practices in the private sector, so caution is warranted in interpreting the results.

The authors used survey data and business results to determine whether sound management practices are correlated to increased business success (they are), and then tried to figure out what business conditions led to better management practices.

While the methodology is inherently tricky, it did reaffirm my priors.

The researchers found:

What could cause these huge differences in management practices across establishments? We found several major factors. First, establishments in more competitive industries (measured by the Lerner index) adopt more structured management practices. Second, those in more pro-business states (proxied by states with ‘right to work’ laws, as in Holmes 1998) tend to use more structured management practices. Third, establishments with more college graduates and firms located near universities (building on the work of Moretti 2004 for identification) tended to adopt more structured management practices. Fourth, being located near a successful large new entrant (using the ‘million dollar plants’ identification strategy of Greenstone et al. 2010) is correlated with more structured management practices, likely because it allows local companies to learn about practices from these large, successful firms.

All these factors matter, but they explained less than half of the variation in management techniques, which means that many other factors matter, too. One hypothesis is that individual managers and CEOs themselves are another critical driver (e.g. Bandiera et al. 2017).

To summarize: good management practices were most often found in (1) competitive industries (2) with less restrictive labor laws (3) located near universities and (4) successful new start-ups.

I know a city educational system that meets all these conditions.

It happened to achieve some of the best student achievement results the country has recently seen.

IV. Yes And

It if it ever occurs, it will take a few decades to scale the charter sector serve the vast majority of low-income students.

For this reason, I appreciate Roland’s efforts to see if charter practices can increase achievement in districts. While I don’t think this is the long-term game, there might be short-term benefits to be had.

But if you want these achievement gains to be sustained, you have to address root causes.

And the root cause of good management is not really about intellectually understanding good management practices.

Rather, it’s about creating the enabling conditions to sustainably execute these management practices.

I believe that non-profit governance will prove to be one of the most important enabling conditions in the public education sector.

Forever Unequal, Immobile, and Politically Divided? Facing Brutal 500 Year Trends

Much of modern philanthropy focuses on reducing inequality, increasing economic mobility, and increasing the efficacy of government.

Three recent books, each in their own way, make the case that philanthropy will likely fail.

Forever Unequal: Inequality Persists Save for Massive Wars, Plagues, State Collapse 

In The Great Leveler: Violence and the History of Inequality from the Stone Age to the Twenty-First Century, Walter Scheidel argues that inequality generally increases over time unless something very awful happens: massively mobilized warfare, societal upending revolutions, plagues, or state collapses.

In short: since the advent of farming, rising inequality has been the default state of humanity across almost all cultures and economic systems.

See below for a history of European inequality. Inequality has always risen save for the Fall of the Roman Empire, the plague, the Black Death, and WWI/WWII.

screen-shot-2017-02-10-at-11-10-21-am

Scheidel marshalls data sets that support this argument in societies across the world.

His final take: while it’s possible that we can inequality through policy and social programs, it’s unlikely.

Yes, individual countries can tweak inequality at the margins, but since the invention of farming, policy has never been able trump long-term immutable trends of increased inequality.

Forever Immobile: The Persistence of Family Status 

In The Son Also Rises, Gregory Clarke utilizes a novel technique – tracking the status of last names over time – to solve many previous problems of economic mobility research, which usually only tracked economic shift of 1-2 generations.

Clarke’s method allows him to avoid the noise of only looking at short time horizons.

If a rich person’s son becomes a poet, it might appear that the family was downwardly mobile. However, if the poet’s daughter then becomes a CEO, the downwardly mobile trend is erased – and so on.

Clarke’s main argument is that, over multiple generations, there’s much less mobility than we thought.

Clarke’s results are stunning: the previous literature estimated intergenerational earnings elasticity to be around ~.3; Clarke’s data raises this estimate to ~.8.

screen-shot-2017-02-10-at-11-15-45-am

Under Clarke’s estimate, family advantages don’t disappear over two or three generations, but ten to fifteen generations.

Forever Divided: The Long Hold of Original Immigration Patterns

In Albion’s Seed: Four British Folkways in America, David Fischer argues that you can trace many of our country’s current conditions to long-ago immigration patterns from Europe (note: I have not read the book yet, and am largely relying on Scott Alexander’s review). 

Fischer tracks the migrations of the Puritans, Cavaliers, Quakers, and Scotch-Irish – and shows how current inequities and culture can in many ways be tied to these 400-500 year old immigrations patterns.

In summarizing the book, Scott Alexander makes a few observations:

If this is true, I think it paints a very pessimistic world-view. The “iceberg model” of culture argues that apart from the surface cultural features we all recognize like language, clothing, and food, there are deeper levels of culture that determine the features and institutions of a people: whether they are progressive or traditional, peaceful or warlike, mercantile or self-contained.

And:

If America is best explained as a Puritan-Quaker culture locked in a death-match with a Cavalier-Borderer culture, with all of the appeals to freedom and equality and order and justice being just so many epiphenomena – well, I’m not sure what to do with that information. Push it under the rug? Say “Well, my culture is better, so I intend to do as good a job dominating yours as possible?” Agree that We Are Very Different Yet In The End All The Same And So Must Seek Common Ground? Start researching genetic engineering? Maybe secede? I’m not a Trump fan much more than I’m an Osama bin Laden fan; if somehow Osama ended up being elected President, should I start thinking “Maybe that time we made a country that was 49% people like me and 51% members of the Taliban – maybe that was a bad idea“.

Many have argued that the post-colonial country formation process led to unworkable patchworks of different cultures be thrown into single countries.

Perhaps this is true of the United States as well.

Will This Time Be Different? 

On one hand, all of the above makes me incredibly gloomy about our prospects of evolving our society into a more equal, mobile, and better governed nation.

On the other hand, the sample size is small: humans have only had post hunter and gather economies for relatively small time frame, and our current institutions and technologies are very different than those of a few hundred years ago.

Moreover, there’s one place we have improved things: we’re incredibly more productive and wealth than we used to be.

So perhaps what we need is the equivalent of the industrial revolution but for inequality, mobility, and political culture.

But, at the very least,  baseline predictions should keep us sober: it will take a radical departure from historical trends to change the trajectory of our nation.

What Happens When What Works for Children Doesn’t Feel Good?

Closing schools does not feel good: it’s painful for families, educators, and politicians.

But closing schools, and opening new better schools, can dramatically help low-income children.

Sometimes, the best thing that can happen to a child is for her school to close.

Closing Schools Led to a +.3 SD Gain for Elementary Students in NOLA 

In New Orleans, Tulane researchers found that closing schools and creating new better schools led to very significant achievement gains:

screen-shot-2016-10-19-at-4-33-16-pm

Elementary students who attended a failing school started .1 SD behind their matched peers – two years later, these same students were .2SD ahead of their matched peers.

This +.3 SD impact is higher than the impacts of most educational interventions, and it equates to closing about 33% of the black-white student achievement gap.

You Don’t Have to Harm Existing Children for the Sake of Future Children

What’s incredible about these results is that the students whose schools were closed increased their student achievement.

Before seeing this data, my guess would have been that closing schools slightly harms existing students but is much better for future students who get to attend a better school without going through the disruption of closure.

But the NOLA data indicates that it’s possible to help both existing and future students, which should increase your belief in the benefits of school closure.

You Should Not Close Failing Schools and Send Children to Other Failing Schools 

In Baton Rouge, school closure did not lead to positive effects. This seems to be because these students enrolled into other failing schools after their original school was closed.

 

Screen Shot 2016-10-19 at 4.45.08 PM.png

For school closure to work, a city needs to either have open spaces in existing higher-performing schools or be opening new high-quality schools.

There are Good and Bad Ways to Close Schools

School closures are hard, but they can be done with respect. Families deserve to know why their schools are being closed; families should get support (and preference in unified enrollment systems) in finding a better school; and political leaders should ensure that empty school buildings are put to good use for the community.

Unfortunately, in many cities, political officials do not close schools thoughtfully. Instead of being honest with families about the poor performance of the school, they let failing schools linger for year until enrollment dwindles and the school folds academically and financially.

It is Difficult to Scale Something that Causes Political Pain

It is unclear to me whether or not deliberate school closure will scale. Reforms that cause political pain tend not to do well over time.

However, opening new great schools need not be politically painful, which bodes well for continued charter growth.

Of course, continued charter growth can lead to the closure of failing schools – and this is exactly why charter moratoriums have some political support.

Charter moratoriums have the potential to reduce pain for adults even as they inflict pain on children.

Can New Orleans Continue to Close Schools? Should It?

Over the past few years, academic performance has stagnated in New Orleans:

screen-shot-2016-10-21-at-8-20-25-am

During this time, there has also been a reduction in school closure activity.

So here is an interesting question: has the stagnation in performance been caused because New Orleans ate up most of the low-hanging fruit of closing schools, or has the stagnation in performance been caused because New Orleans has slowed down on closing failing schools?

At this point, I’m not familiar enough with the data to have strong opinions.

But I do worry that New Orleans, especially as it moves toward more local control, may stop using one of the strategies that has proven to dramatically improve the achievement of its students.