The Nightly Build.
Wednesday, July 22, 202649 min read
Daily Reading · Paper of the Day

Chinchilla beat a model four times its size by training on four times the data

For a fixed compute budget the best split is about twenty training tokens per parameter, a rule that survived an independent replication of its weakest proof and that practice has since deliberately left behind.

11 min read8 sources
Technical Practice · Expert Tools

py-spy profiles a running Python process without changing a line of it

It reads a running interpreter's memory from outside the process, which is why attaching needs no code change and why Linux makes you clear ptrace first.

9 min read6 sources
investing-course

Net income is not the cash a business generates

Costco's latest annual report puts net income at $8.1 billion and cash from operations at $13.3 billion for the same year, and the walk between them is where accrual accounting parts from cash.

9 min read6 sources
Current Affairs · Opinion

France Will Check Every User's Age to Keep Under-15s Off Social Media

Australia has run the same experiment since December, and the early surveys find most of the targeted teenagers still logged in while every adult now has to prove their age to post.

9 min read13 sources
daily-news

France becomes the first EU country to bar under-15s from social media

Macron wants it in force by the September school term, and the Constitutional Council has yet to sign off.

6 min read36 sources
Daily Reading · Word of the Day

A tick's whole world is three signals

Umwelt was an ordinary German word for the environment until a biologist narrowed it to the part of the world a creature can actually sense and act on, the private reality that every nervous system takes for the whole.

5 min read6 sources