goodharts-law

Goodhart’s Law And Why It Matters In Business

Business / By / June 20, 2022

Goodhart’s Law is named after British monetary policy theorist and economist Charles Goodhart. Speaking at a conference in Sydney in 1975, Goodhart said that “any observed statistical regularity will tend to collapse once pressure is placed upon it for control purposes.” Goodhart’s Law states that when a measure becomes a target, it ceases to be a good measure.

Understanding Goodhart’s Law

Goodhart would later admit that his quip was intended to be a humorous, throw-away comment. But it was nevertheless an accurate and perceptive observation about how the modern world functions.

It’s important to note that Goodhart himself had no role in naming the law for which he is named. That distinction goes to anthropologist Marilyn Strathern, who argued in a 1997 paper that the law had uses beyond statistics to evaluation in a broader sense.

An oft-told story of Goodhart’s Law at work can be described by the cobra effect. In India under British colonial rule, the government was troubled by the number of venomous cobras. To reduce their population, the government placed a bounty on every cobra the locals could catch. This strategy worked for a while, but some individuals began breeding the cobras only to kill them later and collect a higher bounty. 

Eventually, the colonial government caught on and scrapped the scheme, causing many of the bred cobras to be released into the wild. The key takeaway of the cobra effect story is that incentives designed to solve a problem end up rewarding people for making the problem worse.

The four forms of Goodhart’s Law

There are generally accepted to be four variations on Goodhart’s Law:

  1. Regressive Goodhart – here, the measures individuals use for their target (goal) are imperfectly correlated with that goal. For example, weight is imperfectly correlated with health because it encourages skipping meals or weighing oneself in the morning with an empty stomach.
  2. Extremal Goodhart – this occurs when a measurement is picked because it correlates with a goal in normal situations. In extreme circumstances however, the measure is erroneous. The human relationship with sugar is a classic example. While sugar was correlated with survival thousands of years ago, the same cannot be said of modern, sedentary lifestyles where sugar promotes obesity.
  3. Causal Goodhart – where the behavior of an individual does not directly affect the goal but has some causal effect on the measure. The number of times a gym membership is renewed does not directly impact how often an individual exercises, for example.
  4. Adversarial Goodhart – where other goals confound the goal a measure is trying to accomplish, such as the cobra effect mentioned above.

Avoiding the impact of Goodhart’s Law

Of the four variations of Goodhart’s Law, only the Regressive Goodhart is unavoidable.

For the remaining three, here are some simple avoidance tips:

  • Conduct regular checks to ensure the measure is still incentivizing in line with the desired outcome or goal.
  • Become aware of Goodhart’s Law and how it operates.
  • Maintain a focus on the end goal while using the measures as a guide only.
  • Reduce bureaucracy and formalism.
  • Use a combination of diversified metrics. A balanced scorecard can be useful here.

Key takeaways:

  • Goodhart’s Law states that when a measure becomes a target, it ceases to be a good measure.
  • Goodhart’s Law was informally coined during a speech by Charles Goodhart. Although the economist was speaking in the context of statistics, the law has broader evaluative applications.
  • Goodhart’s Law is generally categorized into four variations: Regressive Goodhart, Extremal Goodhart, Causal Goodhart, and Adversarial Goodhart.

Related Visual Concepts:

einstellung-effect
Maslow’s Hammer, otherwise known as the law of the instrument or the Einstellung effect, is a cognitive bias causing an over-reliance on a familiar tool. This can be expressed as the tendency to overuse a known tool (perhaps a hammer) to solve issues that might require a different tool. This problem is persistent in the business world where perhaps known tools or frameworks might be used in the wrong context (like business plans used as planning tools instead of only investors’ pitches).
peter-principle
The Peter Principle was first described by Canadian sociologist Lawrence J. Peter in his 1969 book The Peter Principle. The Peter Principle states that people are continually promoted within an organization until they reach their level of incompetence.
straw-man-fallacy
The straw man fallacy describes an argument that misrepresents an opponent’s stance to make rebuttal more convenient. The straw man fallacy is a type of informal logical fallacy, defined as a flaw in the structure of an argument that renders it invalid.
streisand-effect
The Streisand Effect is a paradoxical phenomenon where the act of suppressing information to reduce visibility causes it to become more visible. In 2003, Streisand attempted to suppress aerial photographs of her Californian home by suing photographer Kenneth Adelman for an invasion of privacy. Adelman, who Streisand assumed was paparazzi, was instead taking photographs to document and study coastal erosion. In her quest for more privacy, Streisand’s efforts had the opposite effect.
heuristic
As highlighted by German psychologist Gerd Gigerenzer in the paper “Heuristic Decision Making,” the term heuristic is of Greek origin, meaning “serving to find out or discover.” More precisely, a heuristic is a fast and accurate way to make decisions in the real world, which is driven by uncertainty.
recognition-heuristic
The recognition heuristic is a psychological model of judgment and decision making. It is part of a suite of simple and economical heuristics proposed by psychologists Daniel Goldstein and Gerd Gigerenzer. The recognition heuristic argues that inferences are made about an object based on whether it is recognized or not.
representativeness-heuristic
The representativeness heuristic was first described by psychologists Daniel Kahneman and Amos Tversky. The representativeness heuristic judges the probability of an event according to the degree to which that event resembles a broader class. When queried, most will choose the first option because the description of John matches the stereotype we may hold for an archaeologist.
take-the-best-heuristic
The take-the-best heuristic is a decision-making shortcut that helps an individual choose between several alternatives. The take-the-best (TTB) heuristic decides between two or more alternatives based on a single good attribute, otherwise known as a cue. In the process, less desirable attributes are ignored.
biases
The concept of cognitive biases was introduced and popularized by the work of Amos Tversky and Daniel Kahneman in 1972. Biases are seen as systematic errors and flaws that make humans deviate from the standards of rationality, thus making us inept at making good decisions under uncertainty.
bundling-bias
The bundling bias is a cognitive bias in e-commerce where a consumer tends not to use all of the products bought as a group, or bundle. Bundling occurs when individual products or services are sold together as a bundle. Common examples are tickets and experiences. The bundling bias dictates that consumers are less likely to use each item in the bundle. This means that the value of the bundle and indeed the value of each item in the bundle is decreased.
barnum-effect
The Barnum Effect is a cognitive bias where individuals believe that generic information – which applies to most people – is specifically tailored for themselves.

Read Next: Heuristics, Biases.

Main Free Guides:

Scroll to Top
FourWeekMBA
[class^="wpforms-"]
[class^="wpforms-"]