National testing: What does it mean for a student to be 'proficient'?
The word 鈥減roficient鈥� is often used to mean suitable, apt, or at best, competent. An amateur cook, student driver, or French 101 student, for example, might describe his or her skills as proficient.
But the National Assessment of Educational Progress (NAEP) 鈥� the only national assessment in the United States since 1990, used as a barometer of student achievement 鈥� defines proficiency as 鈥渄emonstrated competency ,鈥� which experts interpret as high achievement.
This mismatch in definitions causes a lot of confusion when it comes to analyzing scores from 鈥淭he Nation鈥檚 Report Card鈥� every two years. On Tuesday, for example, when NAEP鈥檚 2017 scores were released, it was again evident that analysts and journalists use proficiency as the bar for success, citing that only 30 to 40 percent of 4th and 8th graders in the US are 鈥減roficient鈥� in math and reading.聽
Critics say NAEP鈥檚 far-reaching definition of 鈥減roficient鈥� can directly impact students鈥� education through inflated standards in widely used curricula like Common Core, low morale among teachers and administrators, and unnecessary confusion and disappointment for average Americans. Students in the US are actually improving, say observers, especially over the long term, and NAEP鈥檚 nomenclature can shroud legitimate progress that has been made in education.
鈥淲e have gotten an earful from our stakeholders about the confusion of the word 鈥榩roficient鈥� as we use it,鈥� says Peggy Carr, associate commissioner of the National Center for Education Statistics (NCES), the federal agency that oversees NAEP. 鈥淲e get it, and we are trying to communicate this discrepancy, but it鈥檚 just not an easy task.鈥�
Understanding what 'proficient' means
NAEP sorts students鈥� scores into three achievement levels: basic, proficient, and advanced. And to understand how many US students are performing on grade level, says Dr. Carr, it is far more accurate to look at 鈥渂asic鈥� scores, rather than 鈥減roficient.鈥�
If headlines took this adjustment into account, and used the 鈥渂asic鈥� category, this week鈥檚 news might have focused on results showing聽that among US 4th graders, 68 percent perform聽on grade level in reading, and 80 percent perform on grade level in math. For 8th graders, these rates are 76 and 70 percent, respectively. Overall, scores remained largely the same as they were in 2015, but there is some concern among experts about equity: the highest-performing students made gains in the past two years, while the lowest performing students did worse.
When proficiency rates are interpreted correctly, however, they tell a different story about聽long-term trends: national proficiency rates in 4th and 8th grade math have doubled and tripled respectively since the early 1990s, and reading proficiency for both grades has increased by half.
NAEP鈥檚 aspirational standards might have something to do with these gains, says Sarah Theule Lubienski, a professor of math education at Indiana University, where she focuses on testing equity. NAEP was partially responsible for a big reform movement in math education around 1990, says Dr. Lubienski, in which algebra, probability, and geometry were added to elementary classrooms.
鈥淣AEP was really out ahead鈥� pushing the envelope and saying, 鈥楾his is what we think students should know,鈥� 鈥� says Lubienski. 鈥淚t鈥檚 all in the name of holding high standards for students, making sure there is plenty of room to grow, and that has been achieved.鈥�
Proficiency levels began flatlining in 2009-2010 once curriculum changes from 1990 became mainstream, says Luienski, but today鈥檚 plateau shouldn鈥檛 overshadow 鈥渋ncredible gains鈥� over the last two decades.
After all, says Tom Loveless, a former senior fellow at the Brookings Institution and an education policy analyst, 鈥減roficient鈥� as NAEP defines it is an incredibly high standard to uphold. For an 8th grade student to reach NAEP鈥檚 math proficiency today he or she must master the same聽.
These statistics are often twisted to fit a 鈥渞eformist鈥� narrative, says Dr. Loveless, by those who feel that the US education system needs a total overhaul.
鈥淭here is a huge group of people who want to tell everyone, 鈥楲ook how bad our schools are,鈥� and 鈥楲ook how ignorant our kids are,鈥� and they seize on [NAEP proficiency] because it fits their argument,鈥� says Loveless.聽聽
Alternatives to current names
Carr says misconceptions about proficiency are not intentional on the part of NCES. NAEP鈥檚 terminology was decided back in 1988 鈥� before the No Child Left Behind (NCLB) act, signed into law in 2002, used the term 鈥減roficient鈥� to mean grade level performance, which then only muddled NAEP鈥檚 definition.
鈥淭he confusion really got started long after we released our naming convention,鈥� says Carr.
Changing NAEP鈥檚 naming convention now would be a matter of policy for the National Assessment Governing Board, a group of 26 politicians, educators, and experts appointed by the Department of Education, who oversee achievement levels. And for a test whose reputation lies in reliable, direct year-over-year comparisons, changing names is extra tricky.
A January report by the National Superintendents Roundtable (NSR) and the Horace Mann League, titled 鈥�,鈥� recommends NAEP adopt benchmarks used by international education assessments, such as Progress in International Reading Literacy Survey (PIRLS) and Trends in International Mathematics and Science Study (TIMSS).
Their achievement levels of low, intermediate, high, and advanced would give more a neutral take on student scores, says James Harvey, executive director of NSR, without using the loaded words 鈥渂asic鈥� and 鈥減roficient.鈥� And because聽NAEP informally uses the level 鈥渂elow basic,鈥� Dr. Harvey says swapping in PIRLS and TIMSS鈥檚 four terms would be easy and allow NAEP to keep the scoring measures that give the test consistency.聽
鈥淲e tried to make it clear that we don鈥檛 mind high standards, we just want them labeled correctly,鈥� says Harvey. 鈥淚f they would stop using 鈥榩roficient鈥� and replace with 鈥榟igh,鈥� we would be quite happy.鈥�
