The Nightly Build.
Thursday, July 9, 202633 min read
transformers-from-scratch

Tokens and Embeddings: Turning Text into Vectors

Lesson one of building a GPT from scratch: how a string of text becomes the grid of numbers a transformer can actually read.

13 min read9 sources
positions

Microsoft: The Backlog Is the Moat

Azure grew 40% and Microsoft Cloud crossed $50 billion in a quarter, but the number that describes the moat is a $627 billion book of contracted, not-yet-delivered revenue.

8 min read8 sources
docket

The New York Times v. OpenAI: The Fair-Use Question the Bartz Settlement Left Open

Anthropic paid $1.5 billion to make its book problem go away; the Times refuses to, and its case is the one that will force a jury to rule on whether training on the news is fair use.

7 min read9 sources
the-brief

The Brief: Faster Models, Firmer Rules

OpenAI's fastest model yet ships into a release pipeline that Washington and Brussels are moving, from opposite directions, to gate.

5 min read6 sources