Demis Hassabis just put a number on where we are with AI building AI.
On Masters of Scale, the Google DeepMind CEO said we’re in the early days of recursive self-improvement. AI is making human engineers maybe 3 to 5 times more productive. But humans are still very much in the loop: reviewing code, architecting systems, still writing some of it.
The next phase is the one he flags as riskiest. Closed-loop RSI. AI improving itself with no human reviewer. Faster, yes. Also, in his words, “a very dangerous way to get to full AGI.”
Read that from a business seat.
The person running DeepMind isn’t saying “remove the human.” He’s saying the human is both the bottleneck and the brakes.
Marketers should steal this framing:
The multiplier comes from AI doing the work and humans owning the judgment. Review, architecture, taste.
Teams that skip review to ship faster are running their own little closed loop. Off-brand copy and wrong numbers, compounding at scale.
The skill worth building now isn’t prompting. It’s reviewing. Knowing what good looks like, fast.
Some workflows will go fully autonomous. Until then, the human in the loop isn’t overhead. It’s quality control with a pulse.
Where’s your team? Human in the loop, or quietly letting the loop close? …more
Hundreds of people are reading ChatGPT conversations (and you probably agreed to it)
After last week's math controversy, this is the second time in a week the question has come up: what actually happens to what you type into a chatbot?
Do you paste your blood test results into ChatGPT to ask what the values mean, or rehearse the conversation with your GP in advance? Then a hired reviewer may read that conversation and give the answer a score. That's according to internal documents and real user conversations obtained by tech site 404 Media. The setting that makes this possible is on by default for every free, Plus and Pro account.
What's going on?
Internally, the program is called Project Lily. OpenAI, the company behind ChatGPT, hires hundreds of people through intermediaries who open a real conversation in a dashboard, summarize in one sentence what the user wanted, and rate four possible ChatGPT answers on a scale of 1 to 7. They watch for flattery, unnecessary emojis and what the instructions call AI talk. The goal is a chatbot that sounds less sycophantic, a problem that has dogged OpenAI for some time.
The reviewers don't see a username. They do sometimes see a summary of the memory: what the user previously used ChatGPT for and, in some cases, roughly where that person lives. A filter is supposed to remove personal data before a conversation reaches a human. OpenAI's own description of that filter says it makes mistakes, especially with short texts. In some of the conversations 404 Media saw, the user explicitly asked ChatGPT to keep the contents to itself.
When asked where OpenAI has told users that people can read their conversations, no answer came. After publication, the company pointed to a help page. The setting "Improve the model for everyone" was updated, with a better explanation of how to turn it off. That humans read along is still not mentioned. …more
Humans are reading your AI chats — not just OpenAI.
Anthropic & Google confirm they review chats too. What's new is the intimacy: people use chatbots as therapist, coach, rehearsal space. "Private" rarely is. Set a policy first.
https://www.404media.co/inside-project-lily-the-humans-reading-your-chatgpt-chats/#AIGovernance#InfoSec
Human reviewers reading your AI chats: it's not just OpenAI
Anthropic, the maker of Claude, confirmed to 404 Media that it also has people read along, but only for users who have turned on the training setting themselves. Google simply puts it in Gemini's fine print: "Humans review some saved chats to improve Google AI."
The practice isn't new. In 2019, it emerged that Apple and Amazon employees were listening to Siri and Alexa recordings, including accidentally recorded conversations in bedrooms. What's new is the intimacy. An AI chatbot feels like a private one-on-one conversation, and people use it as a therapist, as a coach and as a place to practice what they're going to say to their boss.
This summer's pattern
It's the third time in a few months that "private" turns out to mean something different with AI chatbots than users think.
In July, a Reddit user found hundreds of shared Claude conversations in Google, including résumés with names and phone numbers and an unpublished blog post about a company project. Anyone who clicks "share" creates a public web page. That the page can end up in a search engine isn't mentioned. Grok, Elon Musk's chatbot, had the same problem a year earlier with more than 370,000 conversations.
And last week there was the math controversy: OpenAI could "not rule out" that a mathematician's use of its tool, stripped of his name, improved the model that then solved that very same problem.
To Read or Not to Read the Code? https://every.to/source-code/to-read-or-not-to-read-the-code
1 big thing: Don't miss this shift — AI is ready to run your work in the dark. Don't let it turn the lights out in your head too.
Shipping more has never been easier. Understanding what you're shipping has never been more at risk.
Why it matters: B2B marketers building AI-assisted workflows face the same trap engineers do. The system gets smarter. You get faster. But the judgment that makes you valuable — knowing which of two reasonable-sounding plans will hurt you six months from now — quietly erodes if you let AI handle everything without staying in the work.
Driving the news:
Kieran Klaassen, GM of Every's AI email product Cora, found himself shipping faster than ever while feeling his own thinking get softer. Researchers Margaret Mitchell, Avijit Ghosh, and Samir Passi confirmed the pattern — extended AI agent use measurably erodes the vigilance, critical thinking, and domain skill that human oversight depends on.
→ The phenomenon dates back to 1983 — called the "irony of automation" — where the more capable the automation, the more human skill erodes
→ AI just makes it move faster
Zoom in:
Klaassen's solution: build a deliberate loop for his own learning alongside the AI.
→ His four practices: keep a list of gaps, ask for mechanics not just diffs, recover the reasoning behind the code, and let the model quiz you
Yes, but: This takes discipline most people won't apply. The excuse that you don't have time is exactly what AI removes — but the desire to learn has to come from you.
Be smart: Audit one AI-assisted workflow you run today. Can you explain why it works? Can you catch it when it fails? If not, you have a judgment gap, not a tool gap.
The bottom line: The tools that gave you an edge are becoming easy to copy. The judgment to know where to point them is not.
https://every.to/source-code/to-read-or-not-to-read-the-code#AIMarketing#B2BMarketing…more