Research
We use rigorous research to help us understand whether our work is increasing opportunity for students and families.
We use research to measure how school system reforms affect student learning and longer-term outcomes, such as post-secondary attainment, employment, and earnings.
We recognize that education is also about instilling values, mindsets, and habits that can help a child lead a meaningful life. These attributes are very hard to measure. Additionally, different families may want different types of educational environments for their children. For both of these reasons, we don’t believe that there are objective, universal measures that can capture all components of schooling. This is why we also care about understanding which schools are consistently in high demand from families.
We try to balance these two approaches in our work. We work with researchers to examine which schools are increasing student learning and leading to better life outcomes, as well as which schools parents want most for their children.
We want to learn if all public schools improve when cities increase the number of schools governed by non-profit organizations, adopt enrollment systems that provide families with transparent information on school options and quality, and selectively intervene to improve underperforming schools.
New Orleans, Washington D.C., Denver, and Newark have adopted some version of this approach. These cities vary greatly in their politics, leadership, and public school governance, but all have seen real improvements in citywide academic performance.
In the next phase of our work, we want to learn if results hold as additional cities adopt these reforms. We also want to learn whether student achievement gains will translate into improvements in post-secondary attainment and other long-term outcomes.
We are most confident that high-quality, non-profit public charter schools increase educational opportunity for low income students in urban areas.
Very few public policy innovations succeed. Even fewer succeed at scale. We believe that public, non-profit charter schools, which now serve millions of students, are one of the most important breakthroughs in public education.
There is clear research showing that urban, non-profit public charter schools:
- Increase academic achievement for low income students
- Improve over time, even as they scale to serve more students
- Either improve or don’t negatively affect student achievement in traditional public schools.
It is very rare that a social sector innovation works best with those who need it the most and gets better as it serves more people.
Non-profit public charter schools have achieved this. Equally important, non-profit public charter schools can only exist if parents choose them; they are passing both the research and parent demand tests.
We are unsure exactly how test scores are related to long-term life outcomes.
Researchers disagree about the extent to which test score gains are a reliable proxy for improvement in longer-term outcomes like college enrollment, college graduation, and earnings.
Our current understanding of the research is that: (1) schools that significantly decrease student test scores do not increase postsecondary success; and (2) schools that have neutral and positive impacts on test scores have both been shown to increase postsecondary success.
This fits our intuition. Attending very poor performing schools creates a lot of risk for children. Children in these schools often don’t learn basic reading and math; the schools are often unsafe; and dropout rates tend to be high. It’s not surprising that these types of schools are not associated with students thriving later in life.
However, test scores (and mastering academic content) is just one piece of schooling. Some schools may be very effective at imparting skills that help students succeed later in life even if they do not raise achievement on standardized tests.
We are committed to growing the evidence base to better understand how schools affect students’ long-term success.
While we are optimistic about our approach, it is not the only promising way to improve public education.
Rigorous evaluations have shown that early childhood education, small group tutoring, and managed professional development for teachers can significantly raise student achievement. Research also shows that higher spending on public education can increase test scores and high school graduation rates, particularly for low-income students, and that integrated schools improve academic and adult outcomes.
We are also optimistic about innovations at the high school level. Much more can be done to create a better transition for kids to thrive in careers and postsecondary education. We are hopeful that some of these approaches will achieve success and be tried at greater scale.
Lastly, we believe that K-12 education is just one piece of the puzzle in improving our country. While this our focus, we hope that others achieve amazing breakthroughs in public and private sector innovations.
Research Appendix
- New Orleans: What Effect did the New Orleans School Reforms have on Student Achievement, High School Graduation, and College Outcomes?
- The reforms increased student achievement by 11-16 percentiles; increased the high school graduation rate by 3-9 percentage points; increased the college entry rate by 8-15 percentage points; increased the college persistence rate by 4-7 percentage points; and increased the college graduation rate by 3-5 percentage points.
- Washington, D.C.: DC Public Education Reform Amendment Act (PERAA) Report No. 4: A Closer Look at Student Achievement Trends in the District of Columbia; School Years 2006-2007 & 2012-2013
- Student achievement significantly increased since the implementation of mayoral control, and only a small portion of this improvement is attributable to demographic changes.
- What do families want and why? New Orleans families and their school choices before and after Katrina
- In New Orleans, distance from home to school, academic performance of schools, and extracurricular activities predict school choices at all grade levels.
- Market signals: how do DC parents rank schools and what does it mean for policy?
- In Washington D.C., distance to home, academic performance of the school and the characteristics of its students, including their race and income, predict choices.
- Do parents value school effectiveness?
- In New York City, parents valued high-achieving peers (absolute test scores) over school effectiveness (student growth).
- Urban charter school study: report on 41 regions
- Urban charters schools significantly outperformed traditional schools; .06 SD effect in math and .04 SD effect in ELA.
- Charter schools: a survey of research on their characteristics and effectiveness
- Nearly all randomly controlled studies of urban charter schools found positive effects.
- Charter Schools and the Achievement Gap (2018)
- On average, charter schools perform at about the same level as traditional public schools. But urban charter schools and those serving low-income and minority students, produce the largest gains.
- Can Successful Schools Replicate? Scaling Up Boston’s Charter School Sector.
- The average effectiveness of Boston’s charter middle school sector increased a doubling of charter enrollment.
- Charter Schools Show Steeper Upward Trend in Student Achievement than District Schools
- Charter students made greater academic gains on NAEP between 2005 and 2017 than did students attending traditional district schools. The difference amounts to nearly an additional half-year’s worth of learning. Gains were largest for African American and low-income students attending charter schools.
- How Do Charter Schools Affect System Level Test Scores and Graduation Rates? A National Analysis
- Charter schools increase average graduation rates and math and reading scores across all types of publicly funded schools when charter schools open in their districts.
- The Effect of Charter Schools on Students in Traditional Public Schools: A Review of the Evidence
- A meta-analysis finds that in 15 out of 16 regions studied, charter school growth had positive or neutral effects on student learning in traditional schools.
- Fiscal and Education Spillovers from Charter School Expansion
- Charter expansion increased instructional spending in traditional public schools and had a small, positive effect on non-charter students’ achievement. A 5 percentage point increase in charter school attendance increased non-charter student test scores by 0.03 standard deviations in math and 0.02 in ELA, a modest improvement.
- In Pursuit of the Common Good: The Spillover Effects of Charter Schools on Public School Students in New York City
- Students attending a district school co-located with a charter school perform 0.08 standard deviations better in math and 0.06 standard deviations better in reading, while those in district schools within a half-mile of a charter school perform 0.02 standard deviations better in both math and reading.
- School district reform in Newark: within and between school changes in achievement growth
- School opening and closures strategies had larger positive effects than school improvement.
- Extreme measures: when and how school closures and charter takeovers benefit students
- Closures had positive effects when combined with high-quality school expansion; closures had negative effects when not combined with new high-quality options.
- Lights off: practice and impact of closing low-performing schools
- Post-closure, students who enrolled in better schools saw achievement gains; those who transferred to lower-performing schools did not.
- High school closures in New York City
- Students previously assigned to a closed school saw +15 percentage point increase in high school graduation by attending a different school.
- The effects of New York City’s small school high schools of choice on post-secondary enrollment
- Small high schools substantially increased post-secondary enrollment and persistence.
- The Impact of Scaling the New Orleans Charter Restart Model on Student Performance (2017)
- Charter restarts in both New Orleans and Tennessee showed significantly higher academic growth compared to the schools they replaced.
- Do impacts on test scores even matter? Lessons from long-run outcomes in school choice research (2018)
- A recent meta-analysis found a weak relationship between test score impacts and post-secondary attainment. Schools with positive test score impacts and ones with neutral impacts both increased attainment outcomes. However, schools with negative test score impacts do not increase attainment.
- No Excuses Charter Schools and College Enrollment: New Evidence from a High School Network in Chicago
- Seven to nine years after the admissions lottery at Noble, lottery winners were 10 percentage points more likely to attend college and 9.5 percentage points more likely to enroll for at least four semesters.
- Long-Term Impacts of KIPP Middle Schools on College Enrollment and Early College Persistence
- Students who were lotteried into a KIPP middle school were ~7 percentage points more likely to enroll in a 4-year college than students who applied but were not offered admission. Looking at only those students who actually attended a KIPP middle school, the impact on college enrollment increased to ~13 percentage points. Researchers also found a positive but statistically insignificant impact on 2-year college persistence.
- The Production of Human Capital in Developed Countries: Evidence from 196 Randomized Field Experiments.
- Early childhood investments, high-dosage tutoring, ‘managed’
professional development for teachers, and charter schools are most
promising interventions for increasing achievement.
- Early childhood investments, high-dosage tutoring, ‘managed’
- Does School Spending Matter? The New Literature on an Old Question.
- The recent quasi-experimental literature that relates school spending
to student outcomes overwhelmingly supports a causal relationship
between increased school spending and student outcomes.
- The recent quasi-experimental literature that relates school spending
- Long-Run Impacts of School Desegregation and School Quality on Adult Attainments.
- For African American students, school desegregation significantly
increased both educational and occupational attainments, college
quality and adult earnings, reduced the probability of incarceration,
and improved adult health status;
- For African American students, school desegregation significantly