• Investing
  • Stock
Round Table Thoughts
  • Economy
  • Editor’s Pick
Home Economy Goodhart’s Law Explains School Decay
Economy

Goodhart’s Law Explains School Decay

by January 5, 2023
by January 5, 2023 0 comment
Share
0
FacebookTwitterPinterestWhatsapp

Everywhere in education, you see incentives at work. The incentives, though, are so far removed from the actual goals of education that they produce perverse results. 

Goodhart’s Law is usually stated, “When a measure becomes a target, it ceases to be a good measure.” Economics textbooks often use the allegory of a maker of nails, who receives word that his measure of success at producing nails will be based on the number of nails made. He retools his factory, adjusts his resource use, and produces as many nails as possible, even though many are too thin, or small, or bent to use. When his higher-ups decide to measure productivity on the weight of nails, instead, he makes only a few very large nails, too heavy to be used. Once your incentives are aligned in service of a particular metric, in other words, that metric isn’t an objective measure anymore. 

In the context of education, Goodhart’s law predicts that when dry data, like test scores or school rankings, become the primary or proxy focus of education, the quality of actual learning suffers. Students rightly intuit that high test scores matter much more than learning and understanding the material. Teachers are motivated to focus on test-taking strategies (which have limited real-world value) and neglect important but difficult-to-quantify areas of knowledge. Grade inflation becomes commonplace since the grade matters more than mastery of the material. The evaluation of student learning becomes unmoored from the learning itself, with predictably problematic results. 

We observe this again and again in education. Bureaucrats and lawmakers attempt to set standards that look like “success” from afar, and the schooling system retools production in service of those measures. Because the actual outcomes we want from education are idealized and difficult to measure (such as a population with good civic skills and critical faculties) central planners choose one terrible measure after another, and warp the whole system’s priorities in the process.

Universities Hack the Rankings

Private, Boston-based Northeastern University made a key discovery in the 1990s: the most statistically important metric for a university’s long-term financial viability and success is its ranking in the U.S. News & World Report’s annual “Best College” rankings. At this third-tier commuter school struggling to keep the doors open, leadership decided to pour its efforts into raising its U.S. News rank. Northeastern would crack the top 100 schools by reverse engineering the statistical criteria that fed the rankings. 

Northeastern capped many classes at 19 students, because the formula rewards classes under 20 students. The institution adopted an easy online application system, and recruited heavily, because more students applying (at $75 each) meant a lower ratio were accepted, contributing to rankings for selectiveness. Northeastern also started enticing lower-credentialed high schoolers to spend their first semester abroad, which excluded them from the GPA calculations for the incoming class. Whether the value of education or the institution’s quality ever meaningfully improved is dubious, and to some extent, beside the point. Northeastern’s ranking rose from 162 to 49 in just 17 years. Tuition prices nearly tripled.

Many other schools have admitted to gaming the formula at U.S. News, to the detriment of student experiences. Others, including George Washington University and Emory University, admit to simply cheating, lying about, or exaggerating the statistics U.S. News surveys collect. 

Another familiar example of the demand for data supplanting educational goals is the official college graduation rate. The graduation rate for “four year” degrees, as reflected in government statistics, is just 33.3 percent. Unwilling to publicize that discomfiting number, record keepers began tracking the graduation rate after six years instead, roughly doubling the rate to 64 percent. To a family planning for their child’s future, that distinction is likely to be crucial, even as it is actively obscured by “transparency” data. 

K-12 Schools Lose the Thread

In K-12 education, schools are much less beholden to any private ranking system, but in fact, more obligated to produce positive data (if not necessarily actual results to support it) thanks to federal oversight. 

Standardized testing, interim assessments, attendance records, graduation rates: the streams of data that teachers and administrators compile should give us insight into the kind of education kids are getting in each school. But do they?

Federal No Child Left Behind and later Race to the Top legislation demanded “robust data” to measure student success, teacher impact, and institutional effectiveness. Quantifiable testing became more important than student wellbeing. Target goals were reduced to lines on a stat sheet. Teachers became tools, teaching to the test and ignoring the rest. Music lessons, physical education, recess, art classes, and other less-structured pursuits atrophied, because administrators didn’t see the clear value of creativity and play to boosting test scores (though evidence suggests they do). 

Our obsession with data has taken over any semblance of education during the school year. Administrators mandate, and teachers attend, testing-focus training during development days. Testing days have become testing weeks. The utility of data pales in comparison to the costs of collecting it. The price of relying on it may be higher still.  Making the collection broader, more frequent, more granular, serves only to distract from the true purposes of education. Teachers, administrators, and students shift to meet the needs of the data-gatherers, rather than doing what they do (learn, teach) and allowing it to be passively measured.

Under such misguided incentives, the desire to fudge the numbers (perhaps to make them more representative of on-the-ground experience) is very strong. Teachers cheat and encourage students to cheat, memorably epitomized by the Atlanta Public Schools “cheating scandal” in which 35 educators were indicted for changing a total of a quarter-million test answers from wrong to right. While they did the wrong thing, those teachers were operating under incentive structures that made Scantron score-sheets the measure of how much funding and local control teachers could have to serve kids. Faced with irrational measures and unbelievably high stakes, they gamed the system. Federal regulators had made data the master of outcomes rather than the servant.

Wherever and whenever we measure the intangible, we risk warping the aligned incentives. With something as deeply human and distinctly intangible as learning outcomes, it’s easy for the lure of concrete data to supersede what we know to be valuable and meaningful. By disentangling ourselves from measures and rankings, we can return to a focus on what education does for the human mind, not just the data sheets.

You Might Also Like
  • Climate activist Greta Thunberg latest world leader to meet with Ukrainian president
  • Biden running out of time to fulfill 2020 campaign pledge to abolish federal death penalty
  • Iran-backed militia kills 3 US troops just weeks after Biden said Tehran knows ‘not to do anything’
  • Blinken push for humanitarian pauses in Israeli war falls flat with Netanyahu
Share
0
FacebookTwitterPinterestWhatsapp

previous post
ADP beats expectations, US dollar jumps on the news
next post
Unit Auto Sales Weakened in December

You may also like

Could Bitcoin Reach $200000? Market & Expert Insights

February 13, 2025

New ‘Reagan’ movie shows president’s strengths and why he is...

September 1, 2024

Georgia indictment: 2 Trump co-defendants booked in Fulton County jail

August 23, 2023

Florida Rep. Greg Steube released from hospital after 25-foot fall...

January 22, 2023

Interactive Brokers Expands Crypto Services in 2024

October 18, 2024

Trump, Ramaswamy campaigns clap back after Romney says he wouldn’t...

November 29, 2023

US, UK and Australia take next step in integrating AI...

August 11, 2024

Here are the 21 House Republicans who voted no on...

September 30, 2023

Texas House committee debates impeaching Attorney General Ken Paxton

May 28, 2023

‘The article was BS’: Biden’s Cabinet fires back at scathing...

June 7, 2024

    Stay updated with the latest news, exclusive offers, and special promotions. Sign up now and be the first to know! As a member, you'll receive curated content, insider tips, and invitations to exclusive events. Don't miss out on being part of something special.


    By opting in you agree to receive emails from us and our affiliates. Your information is secure and your privacy is protected.

    Recent Posts

    • Week Ahead: NIFTY Stays In A Defined Range; Moving Past This Level Crucial For Resumption Of Upmove

      May 31, 2025
    • Breakouts, Momentum & Moving Averages: 10 Must-See Stock Charts Right Now

      May 31, 2025
    • Leadership Rotation Could Confirm Corrective Phase

      May 30, 2025
    • Run Your Stock Portfolio Like a Pro Sports Team

      May 30, 2025
    • U.S. foreign tax bill sends jitters across Wall Street

      May 30, 2025

    Popular Posts

    • 1

      Trump-era China sanctions ended by Biden may be...

      June 27, 2024 2,765 views
    • 2

      Walz’s honeymoon with China gets fresh scrutiny as...

      August 9, 2024 2,472 views
    • 3

      Biden appointee played key role in recruiting Chinese...

      June 25, 2024 2,451 views
    • 4

      Shein’s global ambitions leaves some cybersecurity experts fearful...

      July 10, 2024 2,432 views
    • 5

      Harris VP pick spent years promoting research facility...

      August 29, 2024 2,308 views

    Categories

    • Economy (7,009)
    • Editor's Pick (2,106)
    • Investing (538)
    • Stock (2,582)

    Popular Posts

    • 1

      Trump-era China sanctions ended by Biden may be revived under new House GOP bill

      June 27, 2024
    • 2

      Walz’s honeymoon with China gets fresh scrutiny as Harris camp blasts ‘lying’ critics

      August 9, 2024
    • 3

      Biden appointee played key role in recruiting Chinese businesses to Delaware: ‘Longtime friends’

      June 25, 2024
    • 4

      Shein’s global ambitions leaves some cybersecurity experts fearful of Chinese spy threats

      July 10, 2024
    • 5

      Harris VP pick spent years promoting research facility that collaborated with ‘Chinese military company’

      August 29, 2024

    Latest News

    • Week Ahead: NIFTY Stays In A Defined Range; Moving Past...

      May 31, 2025
    • Breakouts, Momentum & Moving Averages: 10 Must-See Stock Charts Right...

      May 31, 2025
    • Leadership Rotation Could Confirm Corrective Phase

      May 30, 2025

    Categories

    • Economy (7,009)
    • Editor's Pick (2,106)
    • Investing (538)
    • Stock (2,582)

    Disclaimer: RoundTableThoughts.com, its managers, its employees, and assigns (collectively “The Company”) do not make any guarantee or warranty about what is advertised above. Information provided by this website is for research purposes only and should not be considered as personalized financial advice. The Company is not affiliated with, nor does it receive compensation from, any specific security. The Company is not registered or licensed by any governing body in any jurisdiction to give investing advice or provide investment recommendation. Any investments recommended here should be taken into consideration only after consulting with your investment advisor and after reviewing the prospectus or financial statements of the company.

    Copyright © 2024 RoundTableThoughts.com. All Rights Reserved.

    Round Table Thoughts
    • Investing
    • Stock
    Round Table Thoughts
    • Economy
    • Editor’s Pick

    Read alsox

    GOP pushback to ‘woke’ ESG investing...

    February 13, 2023

    Maine Gov. Mills to give budget...

    February 1, 2023

    Bipartisan bill would allow people who...

    August 2, 2023
    Sign In

    Keep me signed in until I sign out

    Forgot your password?

    Password Recovery

    A new password will be emailed to you.

    Have received a new password? Login here