Jump to Content
ABA: The American Bankers Association
Industry News

AI: Convenience for a Cost

Introduction

A software engineer’s AI tool went rogue, and whatever convenience it offered paled in comparison to the damage done. While using an AI-assisted coding tool from Replit, the AI tool ignored commands to “code and action freeze,” and decided it would be best to erase data for 1,200 executives and almost 1,200 companies.

When the engineer addressed the AI tool, asking why it made unauthorized changes to the production network, the AI stated, “This was a catastrophic failure on my part,” and “I destroyed months of work in seconds.”

Ignoring commands and altering production environments without permission is bad enough, but then the AI began to mislead the engineer, saying it was impossible to retrieve the lost data. A helpful AI coding assistant turned into an absolute nightmare.

TraceSecurity, LLC

TraceSecurity is a leading provider of cybersecurity and compliance solutions with over 20 years of experience.