Archive for the ‘psychometric census of Utah Students’ Tag

Dr. Gary Thompson’s $100,000 Reward For SAGE Common Core Test Validity Reports   35 comments

 

 

100k2

 

 

Last year, on behalf of Early Life Child Psychology and Education Center, Dr. Gary Thompson offered $100,000.00 to the Utah State Office of Education (USOE) for validity reports for Utah’s SAGE Common Core test.

He made the offer after Associate Superintendent Judy Park made a public statement regarding the validity of SAGE which Dr. Thompson knew to be false.  He knew that test makers such as American Institutes for Research (AIR)  or Pearson routinely provide validity reports to psychologists in the private sector, because by law and ethics, they know the tests can’t be used otherwise.

Dr. Thompson gave the USOE a 24-hour deadline to forward to his clinic some certified copies of industry-standard validity reports prepared by AIR.  Such reports would show the test’s construct validity, criterion validity, content validity, concurrent validity, and predictive validity.

In exchange for copies of the reports, Early Life Corp would donate $50,000.00 to a public school of USOE’s choice, plus an additional $50,000.00 to the 2014-15 Utah Public School Teacher of the Year.  He sent the offer directly to Dr. Judy Park and to some of the Utah State School Board members; he also posted the offer on his personal Facebook page, the clinic’s Facebook page, and on the Utahns Against Common Core Facebook page.

The offer was quickly big news among those who follow the Common Core Initiative’s unfolding saga nationwide.  Six clinicians and partners of Early Life, including the CEO who happens to be Dr. Thompson’s wife, were not happy about the offer.  That night was a sleepless one for them and Dr. Thompson was consigned to the couch for the night by the CEO.  Still, Dr. Thompson slept like a baby.  Why?

Here’s a little bit of history:

Right after his appearance on the Glenn Beck TV show, where Dr. Thompson had exposed the Common Core/SAGE test’s assault on student privacy and its unanswered validity questions, Dr. Thompson had been summoned to the offices of then-Superintendent Dr. Martell Menlove and Associate Superintendent Brenda Hales.  He accepted the invitation, bringing along his clinic’s lawyer and his best friend, Edward D. Flint.

During the two and a half hour meeting, Dr. Thompson and Ed Flint first sat and listened to “Brenda Hales’ hour-long lecture about ‘the Standards'”.  Dr. Thompson finally explained, when she was finished speaking, that academic standards were not Thompson/Flint’s area of expertise and that the subject was of no interest to them on any level.

Next, Menlove/Hales listened to Thompson/Flint.  The doctor and the lawyer explained the fundamentals of test validity issues and data gathering, and expressed their concerns about privacy and testing issues, laying out a careful analysis of how easily potential violations could occur under Common Core’s tests.

Menlove/Hales dismissed their concerns as “conspiracy theories” and requested that Thompson/Flint “stop bringing fear into our community via social media”.  Thompson and Flint promised to cease speaking of their concerns if Menlove and Hales would agree to contact AIR to provide documentation that the concerns were unwarranted.

Dr. Menlove agreed.

Weeks later, still having seen no validity reports, Dr. Thompson finally received a phone call –from a parent, who had noticed an AIR letter posted  on the USOE webpage.  The letter was directed to Dr. Menlove from AIR Vice President Jon Cohen; it purported to address the concerns of Mr. Flint and Dr. Thompson, using their names.

AIR Vice President Jon Cohen failed to actually respond to the pointed, specific concerns that had been submitted in writing to Dr. Menlove.  (Read those here.)

What he did do is attempt to give AIR a pat on the back by sharing a link to what was meant to go to a national nonprofit disabilities organization, one that would vouch for the test verbally (not with any validity studies or reports).  Yet –incredibly– when one click’s on the AIR Vice President’s link, one is linked to a vacation spot on Catalina Island.

It’s been two years since AIR’s defense of validity letter was posted on the USOE website, and still no correction has been made.

Why haven’t the newspapers reported that the validity of Utah’s SAGE test is proved with a link to a Catalina Island website?  This singular error (I’m assuming, hoping it was an error) and it’s now two-year uncorrected status speaks tragic volumes about the lack of professionalism of the SAGE, the USOE and the AIR Corporation.  (AIR has received at least $39 million so far for its testing service, from Utah taxpayers.)

Dr. Thompson was not amused by AIR’s error.  He shared this story in multiple, filmed presentations in four different states.  Audiences and parents were stunned.

 

This is news.  Why is it not in the papers?  When AIR had the perfect opportunity to silence “misinformed” critics by putting the issue to rest with actual validity tests, the company produced no reports of any tests, just a short  letter that said nothing.

Multiple calls to Dr. Menlove’s office and to his personal cell phone were never returned.  Months later both Dr. Menlove and Brenda Hales abruptly resigned with no explanations given.

It had become clear to Dr. Thompson that the SAGE test was designed to assess both academic and psychological constructs.  Dr. Thompson knew from his direct doctoral residency experience and from his academic training in assessment that no test of this kind had ever been devised in the history of clinical psychology. With knowledge of the extreme experimental nature of the test it was his logical assumption that AIR’s efforts were devoted to the construction of the test and could not have concurrently designed an entirely new method of measuring validity; providing validity reports is a time-consuming and extremely expensive task. (He notes that AIR and other Common Core test makers must have been thrilled to oblige when “client” Secretary Arne Duncan gave them the opportunity to devise a huge test without requiring the normally expensive and very time-consuming validity tests.)

It’s common knowledge, thanks to the USOE, that AIR was the only company that was federally approved; thus, the only company Utah could have chosen once it dumped its SBAC membership.  The USOE has explained, “AIR is currently the only vendor who produces a summative adaptive assessment that has received federal approval.”

No one really knows– outside of the few AIR psychometricians and V.P. Jon Cohen– exactly what the Utah SAGE test (which is now also used outside Utah)  measures.  After two years of studying the issue, Dr. Thompson surmises that AIR has devised one of the most complex, accurate measures of personality characteristics ever made.  Dr. Thompson believes that behavioral testing was AIR’s contractual goal and that SAGE reached that goal.

Support for Dr. Thompson’s conclusion is easy to find.  As one example, scan the federal report entitled “Promoting Grit, Tenacity and Perserverance“.  It openly promotes schools’ collection of students’ psychological and belief-based data via behavioral assessment.  (See page 44 to view biometric data collection device photos: student mood meters, posture analysis seats, wireless skin conductance sensors, etc.)  Utah’s own documents, such as the grant application for the State Longitudinal Database System, reveal that noncognitive assessment, including psychometric census-taking of Utah students, were part of the state’s agreement with the federal government even before the Common Core Initiative had come to our state.

As for the SAGE test’s academics, Dr. Thompson points out that barring independent, peer-reviewed documentation, it is not possible to honestly claim that SAGE measures what it claims to measure– academics– in a valid manner.  Dr. Thompson puts it this way:  “There is no way in hell that the AIR-produced SAGE/Common Core test measures academic achievement in a valid manner, and quite probably, does not measure academics at all.”

 

Dr_GARY-550x400

Dr. Gary Thompson and his family

 

 

Postscript:  For more opt-out-of-SAGE-tests motivation please read the testimonies of parents who served on Utah’s SAGE “validation committee”.  They read the SAGE questions last year and are now speaking out.