timelets

Mossing and others, both at OpenAI and at rival firms including Anthropic and Google DeepMind, are ... studying them [LLMs] as if they were doing biology or neuroscience on vast living creatures—city-size xenomorphs that have appeared in our midst.

Anthropic and others have developed tools to let them trace certain paths that activations follow, revealing mechanisms and pathways inside a model much as a brain scan can reveal patterns of activity inside a brain. Such an approach to studying the internal workings of a model is known as mechanistic interpretability. “This is very much a biological type of analysis,” says Batson. “It’s not like math or physics.”

Anthropic invented a way to make large language models easier to understand by building a special second model (using a type of neural network called a sparse autoencoder) that works in a more transparent way than normal LLMs. This second model is then trained to mimic the behavior of the model the researchers want to study.

Creating a model that behaves in predictable ways in specific scenarios requires making assumptions about what the inner state of that model might be in those scenarios. But that only works if large language models have something analogous to the mental coherence that most people do.

And that might not be the case.

...
Another possible solution ... Instead of relying on imperfect techniques for insight into what they’re doing, why not build an LLM that’s easier to understand in the first place?

https://www.technologyreview.com/2026/01/12/1129782/ai-large-language-models-biology-alien-autopsy/

Elon Musk’s artificial intelligence startup xAI is burning through $1 billion a month as the cost of building its advanced AI models

https://www.bloomberg.com/news/articles/2025-06-17/musk-s-xai-burning-through-1-billion-a-month-as-costs-pile-up

“In 1812, the first edition of their anthology, comprising eighty-six stories, came out in an edition of 600, with an apparatus of notes running to hundreds of pages. It was not really intended to be read for pleasure at all by the children and households of its title; it was a learned work setting out to reconfigure the cultural history of Germany along lines that would emancipate it from the monopoly of classical and French superiority. Yet this collection—by the final, standard edition of 1857 the number of tales had grown to 210—was to become the most widely translated work in the world after the Bible and the Qur’an, rendered into more than 160 languages so far, including Xhosa and Tagalog, and still counting.”
...
"Germany wasn’t yet Germany. It was a congeries made up of dozens of principalities and archdukedoms, free Hanseatic ports and archbishoprics. History shows us that the modern nation-state develops long after a national culture and its language: think of Italy and of Dante, writing five hundred years before Italian unification. For centuries, “most of the peninsula had been under German or Austrian or Spanish rule, while the Renaissance, indisputably Italian, was influencing the whole world. The Grimms were living in a time of turmoil and bloodshed. ”
...
“One response to humiliation is to assert cultural riches and distinctiveness, even pre-eminence. ”

--- Warner, Marina;. “Once upon a Time."

We must object in principle that nobody has either a feeling for, or knowledge of, what physically is possible or impossible. What we feel to be an impossibility is actually mere incongruence with our habitual thought style.
...

fundamentally new facts can be discovered only through new thinking.

--- Ludwik Fleck, Genesis and development of scientific fact.

crazy vs stupid.

“I like to use a different metaphor: a garden.
...
On the day you’re born, you’re given a little plot of rich and fertile soil, slightly different from everyone else’s. And right away, your family and your culture start to plant things and tend the garden for you, until you’re old enough to take over its care yourself. They plant language and attitudes and knowledge about love and safety and bodies and pleasure. And they teach you how to tend your garden, because as you transition through adolescence into adulthood, you’ll take on full responsibility for its care.
And you didn’t choose any of that. You didn’t choose your plot of land, the seeds that were planted, or it with something healthier, something we choose for ourselves.”

--- Emily Nagoski. “Come As You Are.”