Model providers
Model providers on Beyond Market Intelligence: a running collection of 5 stories we have gathered and hand-picked because they are worth your time. Every post here touches on model providers in some way — the news, the analysis, the deep dives, and the occasional surprise find. Acme AI is the next-generation, AI-powered spreadsheet platform built to replace Excel and redefine how analysts, data scientists, and enterprise teams work with data. New stories are added to this page as we find them, so check back if you want to keep up with what is happening around model providers, or subscribe to the RSS feed to get them as soon as they are published. Browse the collection below, or head back to the homepage to see everything Beyond Market Intelligence is covering right now.
Agentic security: Enterprises enforce agent permissions two-thirds of the time — and isolate high-risk agents less than one in five
Across 116 enterprises, AI agents are now in production, and so too are the associated security incidents—with over half reporting a confirmed event or near-miss. While two-thirds enforce scoped permissions and 56% monitor activity, a concerning gap exists: fewer than one in five isolate high-risk agents. This containment deficit, coupled with persistent credential sharing, highlights a critical vulnerability as AI-armed attackers are perceived as equally or more capable than current defenses.
Embabel Agent Framework Reaches 1.0
Embabel Agent Framework has officially reached version 1.0, establishing a robust foundation for AI agent development within the Java ecosystem. This framework empowers Java and Kotlin developers to define agents as typed domain objects, leveraging the established Spring AI infrastructure. Embabel’s design combines flexible planning with predefined state machines, supporting multiple model providers for adaptable agent workflows.
The agent evaluation gap: Enterprise AI organizations have a reality-alignment problem, not a coverage problem — and most are shipping to production anyway
Enterprise AI organizations face a critical reality-alignment problem: an “evaluation gap” where increasing agent autonomy outpaces trust in the evaluations meant to govern it. A recent VentureBeat Pulse Research survey of 157 enterprises reveals that half have already deployed an agent that passed internal evaluations but then failed a customer. Despite this, two-thirds are moving toward fully automated deployments—highlighting a concerning disconnect. This research underscores the urgent need for evaluations that accurately reflect real-world outcomes, not just passing scores.
The agent security gap: 54% of enterprises have already had an AI agent incident, and most still let agents share credentials
More than half of enterprises (54%) have already experienced an AI agent security incident or near-miss, highlighting a critical gap between agent autonomy and effective controls. Across 107 organizations, agents are gaining access to sensitive systems while security measures lag, with only a third providing each agent a unique, scoped identity. This VentureBeat Pulse Research reveals that the security stack predominantly relies on borrowed solutions from model providers, leaving a significant vulnerability as AI-enabled attacks evolve.
The agent evaluation gap: Enterprise AI organizations have a reality-alignment problem, not a coverage problem — and most are shipping to production anyway
Enterprise AI organizations face a critical reality-alignment problem: an “evaluation gap” where increasing agent autonomy outpaces trust in the evaluations meant to govern it. A recent VentureBeat Pulse Research survey of 157 enterprises reveals that half have already deployed an agent that passed internal evaluations but subsequently failed a customer. Only 5% fully trust automated evaluation, citing a key weakness – evaluations often don't reflect real-world outcomes. Despite this, two-thirds are moving toward fully automated deployments, highlighting a pressing need for more reliable assurance.