Some thoughts about Anthropic’s new cryptanalysis results

Matthew Green:

Even if models are good at producing real results, they’re much better at producing results that look real but are misleading.

Something that looks real, but isn’t quite?

We have a word for that: artificial.

Artificial intelligence produces artificial output. Seeds after its own kind.

This can be enormously frustrating, and often means that human attention is more necessary than ever.