Thursday, July 9, 202633 min read
transformers-from-scratch
Tokens and Embeddings: Turning Text into Vectors
Lesson one of building a GPT from scratch: how a string of text becomes the grid of numbers a transformer can actually read.
positions
Microsoft: The Backlog Is the Moat
Azure grew 40% and Microsoft Cloud crossed $50 billion in a quarter, but the number that describes the moat is a $627 billion book of contracted, not-yet-delivered revenue.
docket
The New York Times v. OpenAI: The Fair-Use Question the Bartz Settlement Left Open
Anthropic paid $1.5 billion to make its book problem go away; the Times refuses to, and its case is the one that will force a jury to rule on whether training on the news is fair use.
the-brief
The Brief: Faster Models, Firmer Rules
OpenAI's fastest model yet ships into a release pipeline that Washington and Brussels are moving, from opposite directions, to gate.