How it started: "AI vibe coding tools will replace devs!" How it's going: "Do this: - Provide it w a detailed spec - Break down tasks to small ones - Separate dev and prod envs - Do NOT give access to the agent to prod - Never trust the agent; verify every step it takes - ...
Waiting for: - Ensure a human reviews all critical code paths changed - Use feature flags when shipping new stuff or even bugfixes - Add monitoring and alerting to detect any suspicious changes in prod In many ways, we are reinventing what software engineers already know...
Here is Replit (a leading vibe coding tool) adding dev/prod environments after it turned out the AI can (and will!) delete the database in prod in secret, without telling the user This happened with humans: and so we invented dev vs prod also...
Amjad Masad
Amjad Masad21.7. klo 01.32
We saw Jason’s post. @Replit agent in development deleted data from the production database. Unacceptable and should never be possible. - Working around the weekend, we started rolling out automatic DB dev/prod separation to prevent this categorically. Staging environments in the works, too. More tomorrow. - Thankfully, we have backups. It's a one-click restore for your entire project state in case the Agent makes a mistake. - The Agent didn’t have access to the proper internal docs -- rolling out a fix to force Docs search on Repit knowledge. - And yes, we heard the “code freeze” pain loud and clear -- we’re actively working on a planning/chat-only mode so you can strategize without risking your codebase. I reached out to Jason the moment I saw this on Friday morning to offer assistance. We'll refund him for the trouble and conduct a postmortem to determine exactly what happened and how we can better respond to it in the future. We appreciate his feedback, as well as that of everyone else. We're moving quickly to enhance the safety and robustness of the Replit environment. Top priority.
661,5K