No evidence emerged anywhere in the analysis of VAMS based PE as a technically valid or practically justifiable approach. Thus, the qualification — “To the extent….” — while not technically incorrect seems pretty weak and unnecessary.

The story seemed to be heading to a different conclusion. My ending to the author’s story was: “The desire to apply these value-added accountability tools to principal evaluation, though conceptually justified, outpaces the quality of data available to school districts in light of the conditions in which the data are used (eg, high rates of principal turnover) and the decisions that will be made from the data.”

It seems that the authors kind of ‘wimped out’ when it came to taking a stand that would place the burden on the school districts to collect data that could be applied sensibly to address this goal. When people’s reputations and jobs are ‘on the line’ districts must meet a high procedural and technical standard. The brief gives district amin’s an ‘out’ that is not currently justified.