CobbleDB

Perplexity Transforms Search with CobbleDB, Achieving 5x Faster Queries

Perplexity has quietly rebuilt its search backbone, moving from Amazon DynamoDB to CobbleDB, its own key-value store written in Rust.

3 min readInfoQ
Perplexity Transforms Search with CobbleDB, Achieving 5x Faster Queries

Perplexity's move to CobbleDB is the kind of quiet infrastructure decision that rarely makes headlines but deserves close attention. The company didn't just swap one database for another; it built its own key-value store in Rust to replace Amazon DynamoDB, and the reported gains are striking: lower latency, reduced storage costs, and the ability to handle large document batches with high query volumes. This isn't a story about vendor bashing. It's a story about knowing when a general-purpose tool no longer fits the shape of your problem, and having the conviction to build the tool that does.

What makes this noteworthy is not the raw performance numbers alone, but what they signal about the relationship between a company and its infrastructure. Perplexity's search workload is unusual. It processes massive document batches, and the access patterns are specific enough that a managed service like DynamoDB, for all its reliability, carried overhead that became harder to justify at scale. CobbleDB is an admission that "good enough" has a cost, and that cost compounds. For teams watching from the outside, the lesson is not that everyone should write a custom database. Most won't need to. The lesson is that the default choice, even a sensible one, deserves periodic re-examination. This echoes what Cloudflare found when it moved its blog from WordPress to its own EmDash CMS: sometimes the most pragmatic path forward is the one you build yourself, not because the existing tool is broken, but because your constraints have become specific enough that a tailored solution wins on the margins that matter.

From a practical standpoint, the migration matters for anyone who has felt the tension between operational simplicity and performance. Perplexity's engineers had to weigh the cost of maintaining a custom storage engine against the benefits of faster queries and lower spend. They decided the trade-off favored ownership. That is a bold call, and it is not one every organization should copy. But it does raise a useful question for engineering leaders: are you optimizing for the convenience of your stack, or for the experience of the people using it? The answer, more often than not, determines where your real bottlenecks live. And if you are exploring how far you can push decentralized or self-managed architectures, the work at Perplexity and Spritely's approach to building a decentralized web both point in the same direction: control over the underlying system is becoming a competitive advantage again.

Our take is straightforward. Perplexity's CobbleDB is not a signal that DynamoDB is flawed, nor that managed services are obsolete. It is a signal that at a certain scale, the gap between a generic solution and a purpose-built one becomes a business metric. The takeaway you can quote: "When your data access patterns become your product, the default database is a constraint you may need to outgrow." Watch for how Perplexity evolves CobbleDB's feature set in response to production pressure. The hard part is not building a faster store; it is keeping it fast as the workload changes shape. That is the next test, and it is the one that will reveal whether this migration was a one-time win or a durable strategy.

From InfoQ

Perplexity has migrated its search infrastructure from Amazon DynamoDB to CobbleDB, an internally developed key-value store in Rust. This change reduced latency and costs associated with handling large document batches. The new architecture supports high query volumes more efficiently, achieving improved latency and reduced storage expenses while managing significant production traffic.

Read the original at InfoQ