Mikael Helin

Mikael Helin / Journal

AI needs a theory of failure

In high-stakes systems, understanding when a model breaks matters as much as knowing when it works.

Created: 2026 September 01

Updated: 2026 October 31

Branching data lines plotted on graph paper with a technical pen
Model behavior is a question to investigate, not merely a score to optimize.
Machine learning is exceptionally good at finding structure in data. But a convincing pattern is not the same thing as a durable explanation.
Beyond the benchmark

Performance on a held-out dataset tells us something useful, but not everything. When conditions shift, relationships that appeared stable can weaken or reverse. In finance, where incentives and markets adapt, this is not an edge case.

Testing therefore has to include uncomfortable questions: which examples does the model get wrong, how sensitive is it to small changes, and which assumptions are hidden in the training data?

Knowing a model's limits is part of knowing the model.
Mathematics as a constraint

Mathematical structure can give learning systems useful boundaries. It can encode known relationships, suggest meaningful diagnostics, and make failures easier to identify before they reach a user or a decision-maker.

The goal is not to choose between theory and data. It is to let each reveal the other's blind spots.

Mikael Helin / Journal · SAMPLE ARTICLE

Continue reading

All stories

MYSELF & SVELTE

Initial Commit: Welcome to the New Site

System online. Old infrastructure deprecated.