Further reading

More things to explore.

Suggestions beyond the selected shelf, including economics, mechanics and interpretability. These are saved possibilities, with no claim that they have been read.

Mathematics computing and philosophy

  • Visual Information Theory — Colah’s blog

    Entropy, codes and mutual information explained with pictures. The useful connection is between uncertainty and how much space a message needs.

  • The True Method — Gottfried Wilhelm Leibniz

    An early attempt to turn reasoning into systematic calculation. A short route into a surprisingly modern question: which parts of thought can become rules?

  • Three Cultures of Math — Rado’s Radical Reflections

    Different mathematicians can want very different things from a proof. This looks at the styles and priorities behind those differences.

  • The Computational Theory of Mind — Stanford Encyclopedia of Philosophy

    What do we gain by calling thought a computation? A survey of the idea and the questions it still has to answer.

  • Connectionism — Stanford Encyclopedia of Philosophy

    Representations spread across a network rather than stored in one neat place. An introduction to what that buys you, and what becomes harder to explain.

  • A Defence of Common Sense — G. E. Moore

    A defence of ordinary knowledge against philosophical doubt. How much of everyday life should a theory have to preserve?

  • Where Are the Missing Masses — Bruno Latour

    Rules do not always arrive as instructions. Sometimes they are built into the objects around us, quietly shaping what we do.

  • Why Momentum Really Works — Distill

    Why carrying some direction from the last step can make optimisation faster—and when that same momentum sends it past the target.

  • Managing Coupling — Bitsquid development blog

    Software gets harder to change when too many things depend on one another. A practical look at the boundaries and abstractions that help.

  • The ear does not do a Fourier transform — dissonances

    Hearing needs more than a list of frequencies. The trade-off between time and frequency is a useful way into what an auditory representation has to keep.

  • Topological Data Analysis as a Morphometric Method — Frontiers in Plant Science

    Using persistent homology to compare leaf shapes. A concrete test of what a topological summary keeps, and what it throws away.

  • Using group theory to explore the space of positional encodings for attention — Jane Street

    A symmetry-based route into positional encodings: what can group theory tell us about the way attention handles relative position?

  • The Transformer Family Version 2.0 — Lil’Log

    A map of transformer variants and the problems they try to solve. Useful for keeping the architectural changes connected to their purpose.

  • Platonism in the Philosophy of Mathematics — Stanford Encyclopedia of Philosophy

    Do mathematical objects exist independently of us? A tour of the case for that view and the objections it has to face.

  • Formalizing the proof of PFR in Lean4 using Blueprint — Terence Tao

    Organising a large Lean formalisation around a readable proof blueprint. It makes the gap between an explanation and a fully checked proof easier to see.

  • Why Philosophers Should Care About Computational Complexity — Scott Aaronson

    Being computable and being practical are very different things. Complexity changes what some familiar philosophical thought experiments can assume.

  • Performance Hints — Abseil

    Practical notes on making software faster, with measurement doing the heavy lifting. The question is whether the real workload actually improves.

Mechanics

  • Bicycle — Bartosz Ciechanowski

    Forces, steering and balance, with moving diagrams that let you follow the mechanics rather than take them on trust.

  • Internal Combustion Engine — Bartosz Ciechanowski

    Following an engine through its cycle, from pressure in a cylinder to rotation at the output. Timing and geometry make the parts work together.

Neural networks and interpretability

  • Towards Monosemanticity — Anthropic

    Trying to pull interpretable features out of a network with dictionary learning. The challenge is telling a convincing label from a useful explanation.

  • Mapping the Mind of a Large Language Model — Anthropic

    Feature extraction at a larger scale, including the Golden Gate Bridge feature. Changing a feature gives a sharper test than simply naming it.

Economics