interactive charts

The hidden risk in AI is not agents but the chaos between them

The real risk in enterprise AI isn't a rogue agent.

4 min readVentureBeat
The hidden risk in AI is not agents but the chaos between them

The conversation around AI talent is shifting under our feet, and the Navigating AI/ML Job Requirements: A Shift in Expected Skills piece captures part of that unease. But the deeper story, the one Gravitee's Rory Blundell is pointing at, isn't about who gets hired to build agents. It's about what happens after those agents exist. Enterprises are racing to deploy fleets of them, and the real hazard isn't a rogue bot going off-script. It's the invisible tangle of connections between them, each link a handoff that no one mapped, approved, or can fully trace. We agree with Blundell that this is the shadow problem. The industry loves a demo of a single agent doing something clever. Nobody wants to show the board the graph of what happens when fifty of them start talking to each other.

The central claim is that complexity compounds, not with headcount, but with the sheer number of pathways between agents. That's the part that should worry anyone running a pilot. Add a tenth agent and you haven't added ten connections; you've potentially added dozens, because any of them might call any other. We see this as a governance blind spot, not a technology failure. The instinct to treat this like a checklist, approve the agent, log it, move on, is exactly the wrong move. A one-time approval is a snapshot. Complexity runs across a chain, and you can't govern a chain with a stack of static sign-offs. This is why so many enterprise AI programs stall. Someone loses the thread, the security team goes quiet when asked which agent can reach the payments system, and the whole initiative grinds to a halt. It's not because the agents are dumb. It's because the infrastructure to see them clearly doesn't exist yet.

What we'd tell our readers is simple: if you're building agentic AI, your first hire isn't another machine learning engineer. It's the person who can draw the map of every call, every permission, every cross-system dependency. Blundell is right that identity is the necessary starting point. Every agent needs its own name in the register, its own scoped authority, a named human sponsor who answers for it. But he's also right that stopping there just gives you a filing cabinet full of documented agents operating inside a system nobody can explain. The harder piece is real-time oversight across the whole chain, and even that only tells you what already happened. The enforcement piece, the ability to stop an out-of-policy call before it executes, is where most programs skip the line. A dashboard that shows you a breach five minutes ago is a monitoring tool. A system that prevents the breach is governance. You need both.

The uncomfortable truth is that this isn't a technology problem you can buy your way out of. It's a discipline problem. The enterprises that get this right aren't slowing down. They're building toward what Blundell calls Human-Agent Harmony, where scale and accountability grow together. We'd add a practical benchmark to watch for: the next time your team deploys a new agent, ask them to show you the complete path of what it can touch, and then ask who is on the hook when it calls something it shouldn't. If the answer involves a shrug or a meeting invite, you're not ready for production. The real risk was never a single agent doing what it was built to do. It's a hundred of them doing exactly that, all at once, in combinations nobody designed for. That's the multiplication that keeps enterprise AI stuck in pilot purgatory. Solve for that, and autonomy stops being the villain. It becomes the whole point.

From VentureBeat

Agent complexity is the insidious shadow lurking inside enterprises right now that needs a light shone on it.

That’s because enterprises don't deploy a single agent and watch it run, they deploy fleets, each one calling APIs, calling other agents, reaching into applications that were never built with a machine decision-maker in mind. That's the failure mode that should keep you up at night: a windy, complicated system nobody can see clearly enough to govern. But why do things get so opaque so quickly?

Read the original at VentureBeat