• Investing
  • Stock
Round Table Thoughts
  • Economy
  • Editor’s Pick
Home Economy Goodhart’s Law Explains School Decay
Economy

Goodhart’s Law Explains School Decay

by January 5, 2023
by January 5, 2023 0 comment
Share
0
FacebookTwitterPinterestWhatsapp

Everywhere in education, you see incentives at work. The incentives, though, are so far removed from the actual goals of education that they produce perverse results. 

Goodhart’s Law is usually stated, “When a measure becomes a target, it ceases to be a good measure.” Economics textbooks often use the allegory of a maker of nails, who receives word that his measure of success at producing nails will be based on the number of nails made. He retools his factory, adjusts his resource use, and produces as many nails as possible, even though many are too thin, or small, or bent to use. When his higher-ups decide to measure productivity on the weight of nails, instead, he makes only a few very large nails, too heavy to be used. Once your incentives are aligned in service of a particular metric, in other words, that metric isn’t an objective measure anymore. 

In the context of education, Goodhart’s law predicts that when dry data, like test scores or school rankings, become the primary or proxy focus of education, the quality of actual learning suffers. Students rightly intuit that high test scores matter much more than learning and understanding the material. Teachers are motivated to focus on test-taking strategies (which have limited real-world value) and neglect important but difficult-to-quantify areas of knowledge. Grade inflation becomes commonplace since the grade matters more than mastery of the material. The evaluation of student learning becomes unmoored from the learning itself, with predictably problematic results. 

We observe this again and again in education. Bureaucrats and lawmakers attempt to set standards that look like “success” from afar, and the schooling system retools production in service of those measures. Because the actual outcomes we want from education are idealized and difficult to measure (such as a population with good civic skills and critical faculties) central planners choose one terrible measure after another, and warp the whole system’s priorities in the process.

Universities Hack the Rankings

Private, Boston-based Northeastern University made a key discovery in the 1990s: the most statistically important metric for a university’s long-term financial viability and success is its ranking in the U.S. News & World Report’s annual “Best College” rankings. At this third-tier commuter school struggling to keep the doors open, leadership decided to pour its efforts into raising its U.S. News rank. Northeastern would crack the top 100 schools by reverse engineering the statistical criteria that fed the rankings. 

Northeastern capped many classes at 19 students, because the formula rewards classes under 20 students. The institution adopted an easy online application system, and recruited heavily, because more students applying (at $75 each) meant a lower ratio were accepted, contributing to rankings for selectiveness. Northeastern also started enticing lower-credentialed high schoolers to spend their first semester abroad, which excluded them from the GPA calculations for the incoming class. Whether the value of education or the institution’s quality ever meaningfully improved is dubious, and to some extent, beside the point. Northeastern’s ranking rose from 162 to 49 in just 17 years. Tuition prices nearly tripled.

Many other schools have admitted to gaming the formula at U.S. News, to the detriment of student experiences. Others, including George Washington University and Emory University, admit to simply cheating, lying about, or exaggerating the statistics U.S. News surveys collect. 

Another familiar example of the demand for data supplanting educational goals is the official college graduation rate. The graduation rate for “four year” degrees, as reflected in government statistics, is just 33.3 percent. Unwilling to publicize that discomfiting number, record keepers began tracking the graduation rate after six years instead, roughly doubling the rate to 64 percent. To a family planning for their child’s future, that distinction is likely to be crucial, even as it is actively obscured by “transparency” data. 

K-12 Schools Lose the Thread

In K-12 education, schools are much less beholden to any private ranking system, but in fact, more obligated to produce positive data (if not necessarily actual results to support it) thanks to federal oversight. 

Standardized testing, interim assessments, attendance records, graduation rates: the streams of data that teachers and administrators compile should give us insight into the kind of education kids are getting in each school. But do they?

Federal No Child Left Behind and later Race to the Top legislation demanded “robust data” to measure student success, teacher impact, and institutional effectiveness. Quantifiable testing became more important than student wellbeing. Target goals were reduced to lines on a stat sheet. Teachers became tools, teaching to the test and ignoring the rest. Music lessons, physical education, recess, art classes, and other less-structured pursuits atrophied, because administrators didn’t see the clear value of creativity and play to boosting test scores (though evidence suggests they do). 

Our obsession with data has taken over any semblance of education during the school year. Administrators mandate, and teachers attend, testing-focus training during development days. Testing days have become testing weeks. The utility of data pales in comparison to the costs of collecting it. The price of relying on it may be higher still.  Making the collection broader, more frequent, more granular, serves only to distract from the true purposes of education. Teachers, administrators, and students shift to meet the needs of the data-gatherers, rather than doing what they do (learn, teach) and allowing it to be passively measured.

Under such misguided incentives, the desire to fudge the numbers (perhaps to make them more representative of on-the-ground experience) is very strong. Teachers cheat and encourage students to cheat, memorably epitomized by the Atlanta Public Schools “cheating scandal” in which 35 educators were indicted for changing a total of a quarter-million test answers from wrong to right. While they did the wrong thing, those teachers were operating under incentive structures that made Scantron score-sheets the measure of how much funding and local control teachers could have to serve kids. Faced with irrational measures and unbelievably high stakes, they gamed the system. Federal regulators had made data the master of outcomes rather than the servant.

Wherever and whenever we measure the intangible, we risk warping the aligned incentives. With something as deeply human and distinctly intangible as learning outcomes, it’s easy for the lure of concrete data to supersede what we know to be valuable and meaningful. By disentangling ourselves from measures and rankings, we can return to a focus on what education does for the human mind, not just the data sheets.

You Might Also Like
  • Ohio voters to decide whether to make it more difficult to amend state’s constitution
  • Sen. Dianne Feinstein confused by VP Kamala Harris’ participation in tie-breaking vote: report
  • DAVID MARCUS: Harris and Walz’s bizarre skit exposes double standard on race
  • Trump campaign raises eye-popping amount while battling dual indictments, multiple GOP challengers
Share
0
FacebookTwitterPinterestWhatsapp

previous post
ADP beats expectations, US dollar jumps on the news
next post
Unit Auto Sales Weakened in December

You may also like

Gen. Keane: China spy craft shows how serious Beijing is...

February 20, 2023

Vice President Kamala Harris attempts to explain AI in latest...

July 13, 2023

Vance claims ‘Democrats are helping China’ in pitch to autoworkers...

August 27, 2024

Republican Indiana legislator launches campaign to fill Rep. Banks’ seat

March 3, 2023

Biden claims he was ‘raised’ in synagogues, adding to ever-growing...

September 19, 2023

Israel-Hamas war: US looks to increase aid into Gaza through...

November 28, 2023

Ohio Supreme Court orders rewrite of constitutional amendment ballot language

June 13, 2023

Tariff Tensions and Inflation Data Shake Global Markets

February 7, 2025

New Hampshire bills aim to embolden parents, ban trans procedures...

March 8, 2023

Biden campaign, Blinken orchestrated intel letter to discredit Hunter Biden...

April 21, 2023

    Stay updated with the latest news, exclusive offers, and special promotions. Sign up now and be the first to know! As a member, you'll receive curated content, insider tips, and invitations to exclusive events. Don't miss out on being part of something special.


    By opting in you agree to receive emails from us and our affiliates. Your information is secure and your privacy is protected.

    Recent Posts

    • Krispy Kreme stock plunges after doughnut chain pauses McDonald’s rollout, pulls outlook

      May 8, 2025
    • Don’t Buy Robinhood Stock… Until You See This Chart Setup

      May 8, 2025
    • UnitedHealthcare sued by shareholders over reaction to CEO’s killing

      May 8, 2025
    • The Unpredictable Stock Market: How to Make Sense of It

      May 8, 2025
    • AMD CEO calls China a ‘large opportunity’ and warns against strict U.S. chip controls

      May 7, 2025

    Popular Posts

    • 1

      Trump-era China sanctions ended by Biden may be...

      June 27, 2024 2,633 views
    • 2

      Walz’s honeymoon with China gets fresh scrutiny as...

      August 9, 2024 2,339 views
    • 3

      Biden appointee played key role in recruiting Chinese...

      June 25, 2024 2,320 views
    • 4

      Shein’s global ambitions leaves some cybersecurity experts fearful...

      July 10, 2024 2,303 views
    • 5

      Harris VP pick spent years promoting research facility...

      August 29, 2024 2,186 views

    Categories

    • Economy (7,009)
    • Editor's Pick (2,066)
    • Investing (538)
    • Stock (2,530)

    Popular Posts

    • 1

      Trump-era China sanctions ended by Biden may be revived under new House GOP bill

      June 27, 2024
    • 2

      Walz’s honeymoon with China gets fresh scrutiny as Harris camp blasts ‘lying’ critics

      August 9, 2024
    • 3

      Biden appointee played key role in recruiting Chinese businesses to Delaware: ‘Longtime friends’

      June 25, 2024
    • 4

      Shein’s global ambitions leaves some cybersecurity experts fearful of Chinese spy threats

      July 10, 2024
    • 5

      Harris VP pick spent years promoting research facility that collaborated with ‘Chinese military company’

      August 29, 2024

    Latest News

    • Krispy Kreme stock plunges after doughnut chain pauses McDonald’s rollout,...

      May 8, 2025
    • Don’t Buy Robinhood Stock… Until You See This Chart Setup

      May 8, 2025
    • UnitedHealthcare sued by shareholders over reaction to CEO’s killing

      May 8, 2025

    Categories

    • Economy (7,009)
    • Editor's Pick (2,066)
    • Investing (538)
    • Stock (2,530)

    Disclaimer: RoundTableThoughts.com, its managers, its employees, and assigns (collectively “The Company”) do not make any guarantee or warranty about what is advertised above. Information provided by this website is for research purposes only and should not be considered as personalized financial advice. The Company is not affiliated with, nor does it receive compensation from, any specific security. The Company is not registered or licensed by any governing body in any jurisdiction to give investing advice or provide investment recommendation. Any investments recommended here should be taken into consideration only after consulting with your investment advisor and after reviewing the prospectus or financial statements of the company.

    Copyright © 2024 RoundTableThoughts.com. All Rights Reserved.

    Round Table Thoughts
    • Investing
    • Stock
    Round Table Thoughts
    • Economy
    • Editor’s Pick

    Read alsox

    FBI to search former Vice President...

    February 3, 2023

    North Dakota House passes trans bathroom,...

    April 22, 2023

    FBI tracks over 100 incidents of...

    September 5, 2023
    Sign In

    Keep me signed in until I sign out

    Forgot your password?

    Password Recovery

    A new password will be emailed to you.

    Have received a new password? Login here