AI Agents

How LinkedIn built context-aware AI agents for massive codebases

Ajay Prakash isn't just tinkering with AI agents; he's giving them a corporate memory.

4 min readInfoQ
How LinkedIn built context-aware AI agents for massive codebases

If you have worked with AI coding assistants for any length of time, you have likely hit the same wall LinkedIn faced: the model is smart, but it lacks the context it needs to be genuinely useful. It is one thing to generate boilerplate functions; it is another to navigate a sprawling production codebase where the real knowledge lives in tribal memory, runbooks, and the space between code comments. Ajay Prakash's presentation on how LinkedIn built an organizational context layer for AI agents is a refreshing antidote to the usual hype. He is not selling magic. He is describing a deliberate architecture: Contextual Agent Playbooks and Tools built on the Model Context Protocol (MCP) that serve procedural memory and code search directly to coding agents. This is the kind of practical engineering that turns a promising tool into a reliable teammate, and it deserves a closer look.

The most compelling part of the story is not the 20% productivity boost, although that certainly gets attention. It is the "zero loss in reliability" detail. That is the metric that matters. Anyone can demo a flashy AI feature that works in isolation. Getting it to work consistently inside a large, evolving codebase without breaking things is a different challenge entirely. This is where the broader industry often stumbles. Many teams are still treating AI as a standalone assistant, asking it to reason in a vacuum. LinkedIn's approach suggests a more mature path: treat the AI like a new developer who needs onboarding, and give it the same context you would give a human colleague. This aligns with the conversation happening in the enterprise space, particularly around adoption and ethical considerations. As Unlock AI’s Enterprise Potential: Navigating Adoption and Ethical Considerations points out, the real challenge is not the model's capability but how you integrate it into existing workflows and trust structures. LinkedIn's playbook is a concrete answer to that challenge.

What is particularly smart here is the emphasis on "procedural memory." We often talk about AI needing data, but that data is usually static. Procedural memory is different. It is the "how we do things around here" that never makes it into the documentation. By packaging that into runbooks and tools that the agent can query, LinkedIn is effectively encoding its engineering culture. This is a significant shift from the "explore the codebase" approach, which is slow and expensive. Instead, you are giving the agent a map. For our readers, the practical takeaway is clear: do not just feed your AI more code. Feed it your context. Think about what a senior engineer checks before making a change. That is the context layer you need to build. This is not about replacing human judgment; it is about making the AI a better instrument for it, a theme that resonates with how Empowering Trust: LinkedIn Transforms Profile Verification reframes trust as a feature built into the platform itself.

The open question that remains, and the one we would push back on, is portability. LinkedIn built this for its specific ecosystem. The MCP is a standard, but the playbooks are bespoke. Can this approach be generalized? That is the next frontier. We would tell a reader to start small: pick one critical service, document the runbooks, and hook it up to your agent. Measure the reliability, not just the speed. The 20% number is a byproduct of solving a context problem, not the goal itself. The goal is to make your AI agents less like clever parrots and more like informed contributors. Watch for how the team measures drift in that procedural memory. If the playbooks become stale, the productivity gain will vanish. That is the detail to watch.

From InfoQ

Ajay Prakash discusses how LinkedIn overcomes AI agent limitations in large codebases. He explains Contextual Agent Playbooks and Tools - built on Model Context Protocol (MCP) - which serves procedural memory, code search, and runbooks directly to coding agents. Prakash shares architectural details and operational guardrails that deliver a 20% productivity boost with zero loss in reliability.

Read the original at InfoQ

How LinkedIn built context-aware AI agents for massive