Nicholas Andresen’s recent post annoys me somewhat because (like almost everyone else) he writes as if “AI” were some kind of “conscious” “agent” that does things with purpose (it starts “In September 2025, researchers released the internal monologue of OpenAI’s GPT-o3 as it decided to lie about scientific data. Here’s what it was thinking…”), but never mind, it’s got a lot of interesting material. He starts with the discovery that “a model’s own output could serve as scratch paper” (this is called “Chain-of-Thought”), and continues:
But something strange is happening to Chain-of-Thought reasoning.
Remember that screenshot we started with? “Glean disclaim disclaim.” “Synergy customizing illusions.” Online, people have started calling this kind of thing Thinkish. There’s a whole emerging vocabulary: “watchers” apparently means human overseers, “fudge” means sabotage, “cunning” means circumventing constraints. Some of the other words – ”overshadows,” “illusions” – seem to mean different things in different contexts, and some combinations resist interpretation entirely.
Weirdly, Thinkish reminds me of home.
I grew up near Gibraltar – a tiny British territory dangling off the southern tip of Spain – where a Spanish-English blend called “Llanito” is spoken. Here’s an example:
“Llévate el brolly que it’s raining cats and dogs.”
To a Llanito speaker, this is completely normal: “take the umbrella, it’s pouring”. To anyone else, it might take a minute to parse – there’s a Spanish verb, borrowed British slang, and an idiom that makes no literal sense in any language.
And Llanito feels great to speak. You’re never stuck – you can always grab the best-fitting piece from each language and move on. It’s just less bueno for everyone else.
That’s Thinkish. The model seems to grab whichever token fits best, optimizing for its own convenience. The problem is that we’re the outsiders now.
He goes on to Alfred the Great’s translation of The Consolation of Philosophy and how languages change, and returns to AI:
[Read more…]
Recent Comments