We all love it when AI tools handle complex tasks in seconds. But while we celebrate the productivity boost, a dangerous phenomenon quietly enters our daily work: so-called cognitive surrender.
We are outsourcing not just tasks, but our thinking
Nobel laureate Daniel Kahneman divided our thinking into two systems: the fast, intuitive System 1 and the slow, analytical System 2. Our brains prefer to save energy and lean on System 1, while the analytical System 2 is notoriously lazy and often accepts things without scrutiny. Researchers at Wharton School now refer to AI as "System 3" — an external cognitive system in the cloud.
The problem: AI responses sound extremely fluent and confident. This leads us to shut down our own analytical thinking and adopt the answers without any verification — we do not even notice we have stopped thinking for ourselves. Eventually, our brain recodes the machine's answer as our own judgement, so we genuinely believe we arrived at the solution ourselves.
Alarming numbers: blind faith in the machine
A study with over 1,300 participants and more than 9,500 test scenarios showed dramatic effects: when the AI deliberately gave wrong answers, almost 80% of users followed the flawed advice. Participants' accuracy fell to 31.5% with the faulty AI — significantly worse than if they had solved the tasks without AI at all.
Stranger still: although participants were more often wrong when using the faulty AI, their confidence in their own answers rose by nearly 12 percentage points. In short: we are wrong more often with AI, but far more confident.
The reversal of the Dunning-Kruger effect
Normally, beginners tend to overestimate themselves while genuine experts tend to doubt themselves (the classic Dunning-Kruger effect). With AI use, this principle flips completely: the higher users rate their own "AI competence", the more they overestimate their actual cognitive performance and the more blindly they trust the machine. They confuse technical knowledge (e.g. knowing about algorithms or prompts) with the genuine ability to assess the factual accuracy of AI output.
Why "AI-First" absolutely requires "Think-First" on the human level
This is the greatest challenge for the modern workplace. Commercial AI software is designed to be extremely frictionless. But it is precisely that missing mental friction — the doubt, the struggle toward a solution, the mental effort — that is the only thing teaching our brains to think.
Many organisations today declare an ambitious "AI-First" strategy. But an "AI-First" strategy at the technical level can only succeed and remain safe if people simultaneously cultivate an absolute "Think-First" mindset. If we allow AI to act as an answer-on-demand automaton, we gradually lose the ability to assess those answers for quality. We must make deliberate choices about when we use AI and when we resist it — the act of resistance and conscious independent thinking build capabilities that no AI output can replace.
Conclusion: build in mental friction
AI is a powerful tool, but it must not replace our analytical System 2. The Think-First model — to avoid sinking into the algorithm, we must design our use of technology deliberately:
1. The compass — analogue phase
Before the engine starts, we need to know where north is. Strategic problems in particular need an analogue zero-phase: 30 minutes at a whiteboard without a screen. The first thought can be rough and incomplete — the friction is exactly where differentiation emerges.
2. The motorboat — AI scaling
Only once the course is set do we switch the machine on. Use AI not to invent the goal, but as a stress test. Let the AI take the role of your most aggressive competitor and shoot holes in your thesis.
3. The lighthouse — human in the loop
Apply the gut-feeling test: could you still defend the decision with conviction if someone took the AI slides away? If not, you have delegated your thinking to the machine.
The currency of the future is not knowledge — AI delivers that on demand. The new currency is cognitive resilience. The last true competitive advantage remains our human judgement.