Measurement Incorporated Automated Scoring Most Accurate in NAEP Automated Scoring Challenge

sm论坛 participated in the National sm论坛 of Educational Progress (NAEP) Automated Scoring Challenge sponsored by the National Center for Education Statistics (NCES). NAEP is a gold-standard, nationally representative assessment known as 鈥淭he Nation鈥檚 Report Card.鈥 To date, all NAEP constructed response items have been handscored. The purpose of the Challenge was to determine whether automated scoring models could perform well with a representative subset of grade 4 and 8 NAEP Reading constructed response items. In addition to the score predictions, the Challenge required that submissions demonstrate interpretability of models, analyze models for potential bias based on student demographic characteristics, and provide cost information for putting an automated scoring system into operational use.

Over two dozen teams participated in the Challenge. sm论坛 was one of four grand prize winners with our score predictions exhibiting the greatest accuracy of all the submissions. sm论坛鈥檚 submission was a team effort that involved sm论坛鈥檚 automated scoring, psychometric, and handscoring staff.

sm论坛 looks forward to discussing our scoring engine and how we can assist your assessment scoring. Contact sm论坛 at sm论坛

You can read the NCES press release about the prize announcement here: .

More details on the scoring results are available here: .