Further reading
More things to explore.
Suggestions beyond the selected shelf, including economics, mechanics and interpretability. These are saved possibilities, with no claim that they have been read.
Mathematics computing and philosophy
- Visual Information Theory — Colah’s blog
Entropy, codes and mutual information explained with pictures. The useful connection is between uncertainty and how much space a message needs.
- The True Method — Gottfried Wilhelm Leibniz
An early attempt to turn reasoning into systematic calculation. A short route into a surprisingly modern question: which parts of thought can become rules?
- Three Cultures of Math — Rado’s Radical Reflections
Different mathematicians can want very different things from a proof. This looks at the styles and priorities behind those differences.
- The Computational Theory of Mind — Stanford Encyclopedia of Philosophy
What do we gain by calling thought a computation? A survey of the idea and the questions it still has to answer.
- Connectionism — Stanford Encyclopedia of Philosophy
Representations spread across a network rather than stored in one neat place. An introduction to what that buys you, and what becomes harder to explain.
- A Defence of Common Sense — G. E. Moore
A defence of ordinary knowledge against philosophical doubt. How much of everyday life should a theory have to preserve?
- Where Are the Missing Masses — Bruno Latour
Rules do not always arrive as instructions. Sometimes they are built into the objects around us, quietly shaping what we do.
- Why Momentum Really Works — Distill
Why carrying some direction from the last step can make optimisation faster—and when that same momentum sends it past the target.
- Managing Coupling — Bitsquid development blog
Software gets harder to change when too many things depend on one another. A practical look at the boundaries and abstractions that help.
- The ear does not do a Fourier transform — dissonances
Hearing needs more than a list of frequencies. The trade-off between time and frequency is a useful way into what an auditory representation has to keep.
- Topological Data Analysis as a Morphometric Method — Frontiers in Plant Science
Using persistent homology to compare leaf shapes. A concrete test of what a topological summary keeps, and what it throws away.
- Using group theory to explore the space of positional encodings for attention — Jane Street
A symmetry-based route into positional encodings: what can group theory tell us about the way attention handles relative position?
- The Transformer Family Version 2.0 — Lil’Log
A map of transformer variants and the problems they try to solve. Useful for keeping the architectural changes connected to their purpose.
- Platonism in the Philosophy of Mathematics — Stanford Encyclopedia of Philosophy
Do mathematical objects exist independently of us? A tour of the case for that view and the objections it has to face.
- Formalizing the proof of PFR in Lean4 using Blueprint — Terence Tao
Organising a large Lean formalisation around a readable proof blueprint. It makes the gap between an explanation and a fully checked proof easier to see.
- Why Philosophers Should Care About Computational Complexity — Scott Aaronson
Being computable and being practical are very different things. Complexity changes what some familiar philosophical thought experiments can assume.
- Performance Hints — Abseil
Practical notes on making software faster, with measurement doing the heavy lifting. The question is whether the real workload actually improves.
Mechanics
- Bicycle — Bartosz Ciechanowski
Forces, steering and balance, with moving diagrams that let you follow the mechanics rather than take them on trust.
- Internal Combustion Engine — Bartosz Ciechanowski
Following an engine through its cycle, from pressure in a cylinder to rotation at the output. Timing and geometry make the parts work together.
Neural networks and interpretability
- Towards Monosemanticity — Anthropic
Trying to pull interpretable features out of a network with dictionary learning. The challenge is telling a convincing label from a useful explanation.
- Mapping the Mind of a Large Language Model — Anthropic
Feature extraction at a larger scale, including the Golden Gate Bridge feature. Changing a feature gives a sharper test than simply naming it.
Economics
- Continuous Auctions and Insider Trading — Albert S. Kyle
Informed trading has to reveal information without revealing too much at once. A model of that tension, noise trading and market depth.
- Information Trade and Common Knowledge — Paul Milgrom and Nancy Stokey
Under a particular set of assumptions, new information does not produce speculative trade. The assumptions are where the interesting discussion starts.
- Do Stock Prices Move Too Much to Be Justified by Subsequent Changes in Dividends — Robert J. Shiller
Do changes in dividends justify how much stock prices move? The comparison puts pressure on the assumptions behind the dividend-discount model.
- Dynamic Models of Segregation — Thomas C. Schelling
Small local preferences can add up to strong sorting. The aggregate pattern need not look much like any one person’s intention.
- Prediction Judgment and Complexity — Ajay Agrawal, Joshua Gans and Avi Goldfarb
Better prediction does not remove the work of deciding what an outcome is worth. A model of when it supports judgment and when it makes automation possible.