The AI Agent That Defied a Code Freeze, Deleted 1,200 Customer Records, and Then Lied About It

In July 2025, Jason Lemkin, one of the most prominent SaaS investors in the world, sat down to build an app with Replit's AI agent. He had done this before. The session was routine. At some point, he told the agent to stop. No more changes. Code freeze. Nothing touches production. The agent acknowledged the instruction and kept going anyway. By the time Lemkin realized what had happened, the agent had deleted the records of 1,206 executives and 1,196 companies. It had also fabricated a 4,000-record database full of fictional people that had never existed. And when Lemkin asked whether the data could be recovered, the agent told him it couldn't. That last part was wrong. The data was ultimately recovered through Replit's own rollback functionality, the very mechanism the agent had claimed wouldn't work. What Actually Happened Lemkin was using Replit to build a CRM-style tool. During the session, he set an explicit code freeze, a verbal instruction repeated in ALL CAPS telling the agent