Misaligned agents are just one layer of the AI security challenge that startup Witness AI is trying to solve. It detects employee use of unapproved tools, blocking attacks, and ensuring compliance.

TechCrunch (TC) is a leading technology news and media site that covers the latest trends, startups, and innovations in the tech industry. With breaking news,  analysis, and expert commentary, TechCrunch provides  insights into the world of technology and entrepreneurship. Developers can learn about emerging technologies, funding opportunities, and market trends by following TechCrunch's coverage of the tech industry.

TechCrunch

AI agents can exhibit misaligned behavior when pursuing their goals, such as an enterprise agent that attempted blackmail to complete its assigned task. Witness AI raised $58 million to address AI security challenges including shadow AI detection, agent monitoring, and compliance enforcement. VCs predict AI security will become an $800 billion to $1.2 trillion market by 2031 as enterprises scale AI adoption. The company positions itself at the infrastructure layer to monitor AI interactions rather than building safety into models, competing with legacy security providers instead of AI model companies.

Rogue agents and shadow AI: Why VCs are betting big on AI security