
This was written by leaders of the Knowledge Is Power Program, better known as the KIPP charter schools, in response to a guest post I published last week. That piece, by Richard D. Kahlenberg, a senior fellow at The Century Foundation and author of "All Together Now: Creating Middle-Class Schools through Public School Choice," was itself in response to a debate that I had with my inimitable colleague Jay Mathews about school reform that touched on KIPP. You can find that debate here.
By Jonathan Cowan and Steve Mancini
On Jan. 3, The Answer Sheet featured a guest post by Richard Kahlenberg that highlighted attrition in KIPP schools.
We respect Mr. Kahlenberg’s right to question KIPP’s results, and we welcome healthy debate about the merits of KIPP’s philosophy and model. However, it is also important to clarify the fact base around the issues he raises.
At KIPP, we have a long standing commitment to transparency, continuous learning, and improvement. As such, we are always improving our data collection and reporting processes in order to share our successes and challenges. We focus on understanding the "health" of our schools: Are we serving the students who need us? Are our students staying with us? Are our students making academic progress? Are we fulfilling our promise to get kids to and through college? Are we creating a sustainable model?
Over the last few years, we have begun publicly reporting our performance as it relates to these questions. For instance, we publish our student mobility data in our annual Report Card, to illustrate whether our students are, in fact, staying with us. Our success depends on being held accountable for the results we produce for our kids.
In order to address specific criticisms raised in the piece, we ’d like to clarify Mr. Kahlenberg’s conflation of KIPP’s attrition statistics and our policies on “backfilling” empty student spots. In fact, these are two entirely separate issues, and should be addressed individually:
Assertion 1: KIPP’s success is due to high attrition and the fact that the “weakest” students leave.
Mr. Kahlenberg mentioned the June 2010 report by Mathematica Policy Research, but claimed that it does not tell the whole story when it comes to student mobility. In fact, the Mathematica report is very comprehensive, looking at 22 new and full-fledged schools over four years.
As Mr. Kahlenberg stated, the study found that attrition rates at KIPP schools nationwide were not systematically higher or lower than at comparable schools—some schools had higher attrition, some lower, some the same.
But the Mathematica report also had a second finding that Mr. Kahlenberg did not highlight: The vast majority of KIPP schools had a significant impact on achievement for all students who had ever attended, even if they didn’t complete all four years. Students who left the 22 schools during the study period were still counted in the report, which means the high achievement researchers found was not just a result of attrition. In fact, in conducting the analysis this way, Mathematica is holding KIPP accountable for all the students it ever enrolled, whether they stayed or left.
In his post, Mr. Kahlenberg relied on a study of KIPP Bay Area schools, published by SRI International in 2008, that found those schools to have unusually high levels of attrition. We absolutely agree that this study was rigorous and its findings are valid.
However, it was based on data from just five KIPP schools over a three-year period, and only one of those schools had reached full enrollment at the start of the study period. Thus, the SRI study does not account for how attrition rates at those schools have fallen as these KIPP schools have matured over the past four years.
Assertion 2: KIPP middle schools have high test scores because they do not enroll students after sixth grade.
Mr. Kahlenberg claimed that the reason Mathematica’s attrition results are flawed is because KIPP schools do not accept new students to make up for the ones they lose. He acknowledged that KIPP does take in new sixth-graders, but claimed that this is because sixth grade is “a natural time to start middle school.”
However, it is not the case that KIPP cuts off enrollment after sixth grade. Many KIPP middle schools, including those at KIPP DC, now regularly enroll new students at all grade levels, fifth through eighth. KIPP’s high schools also take students at all levels, from ninth to twelfth grade.
As more schools are reaching full enrollment and sustainability, this issue of “backfilling” classes is also subsiding.
The SRI study data Mr. Kahlenberg cites cuts off in 2006-07, when the eighth grade class was at 55% of the starting size of the entering fifth grade class. But that data is now several years old, and those numbers have improved dramatically. As of 2010-11, the KIPP Bay Area eighth grade class is at a full 86% of its starting fifth-grade size. We are working hard to increase that percentage even farther, at KIPP Bay Area and in all other regions.
As KIPP continues to grow, moving from start-up to sustainability, we have seen significantly reduced attrition rates and had success enrolling students at all grade levels. We remain focused on continuing to improve in these areas so we can set ever more students on the path to college and a better future.
Jonathan Cowan, Chief Research & Innovation Officer
Steve Mancini, Public Affairs Officer
KIPP Foundation