Discussion about this post

User's avatar
thatfirsthello's avatar

Hi Jon, great read as usual and very insightful diagnosis. I liked the idea that most catastrophic failures in complex systems don't come from bad models (and actually models are locally powerful), they come from model monoculture. 2007 wasn’t about quants being wrong on statistics, it was actually about everyone being right in the same way at the same time.

In an investing context, even world class rigor fails when applied inside the wrong system boundary. I thought the Page theory was excellent as it illustrates that a single brilliant model has a ceiling but a collection of them change the ceiling itself, and that when models collide, it's not noise (it's information).

To practice the thinking I tried to layer the thinking onto select episodes that led to the financial crisis in 2007/08, where the different actors used different models but relied on the same hidden assumptions:

1) Housing bubble - model told them it was safe

2) Securitization of debt - slicing mortgages into tranches looked like diversification but In reality everyone still depended on the same market and when the market weakened, everything weakened

3) Rating agencies locked in the monoculture through labelling securities and made the same risk acceptable everywhere

4) The famous Repo 105 - accounting tricks hid the fragility of the system and just made things look safer

So the financial crisis wasn't caused by bad actors or math, it's a system where everyone used the same models and no one modelled the system.

I think the article is brilliant at diagnosis, and how best to operationalize it to get better at decision making real time will be very interesting to see. Perhaps the core shift is to stop asking what does my model say, and deep diving into what kind of problem is this.

Look forward to following the series.

ChrisMatts's avatar

Another great post.

People who use models are actually engaged in a religious belief system, they believe the models work… Like the idea of a dung beetle pushing the sun across the sky. The hardest part of understanding models is to consider what is not included in the model that should be for it to fit reality. In 2007, liquidity was “assumed” which is why the models could not handle a liquidity crisis.

Normally things are excluded from the model (“Assumed”) because they cannot be managed. Liquidity is a systemic issue that cannot be managed by a single agent in the system. Unfortunately the regulators who are responsible for the system do not understand this and have imposed futile rules (based on their model) which make things worse for the economy as a whole. Being aware of the limits, or axioms, of your model is vital but rare. A better way for the system to handle liquidity (especially prime brokerage accounts) would be to introduce shared deposit schemes to protect depositors but that violates the free market beliefs of regulator’s bosses.

This is an important thread that you are pulling.

3 more comments...

No posts

Ready for more?