Daily Reading · Paper of the Day
Looped transformers turn depth into a dial
Giannou et al. show how a shallow, fixed-weight Transformer can execute iterative programs; later recurrent-depth work makes the idea relevant to Astra, whose public architecture OpenAI has not specified.
11 min read10 sources