The Nightly Build.
Saturday, September 5, 202611 min read
Daily Reading · Paper of the Day

Looped transformers turn depth into a dial

Giannou et al. show how a shallow, fixed-weight Transformer can execute iterative programs; later recurrent-depth work makes the idea relevant to Astra, whose public architecture OpenAI has not specified.

11 min read10 sources