Google ML Drift

Google's ML Drift Opens On-Device AI to Any GPU Environment

Google has open-sourced ML Drift, a cross-platform GPU compute engine that finally lets on-device AI run on any GPU environment.

3 min readInfoQ
Google's ML Drift Opens On-Device AI to Any GPU Environment

Google's release of ML Drift is a quiet but significant move that opens on-device AI to virtually any GPU environment, and that matters more than most headlines will admit. By abstracting the complexities of different GPU hardware and low-level APIs, supporting OpenGL ES, OpenCL, Metal, and WebGPU, Google has effectively removed a major friction point for developers who want to run inference locally without being locked into a specific chip vendor or framework. This isn't about competing with cloud-based AI; it's about making the local compute layer as accessible as the spreadsheet interface we already take for granted.

For our readers who build tools that blend data workflows with AI, this is a practical unlock. The same principle that makes A 40% Speed Gain: How AI Optimized a Developer Toolkit Overnight noteworthy, unattended AI runs producing real optimizations, depends on developers having reliable, cross-platform compute to test and deploy those improvements. ML Drift standardizes that foundation. If you've been experimenting with AI agents to accelerate spreadsheet tasks, as covered in Explore 5 Free AI Coding Agents That Unlock Smarter Spreadsheet Workflows, the value multiplies when those agents can run inference on the same machine where your data lives, without requiring a specific GPU brand or cloud subscription. ML Drift makes that scenario more realistic.

The open-source licensing under Apache 2.0 is the right call. It invites contribution, inspection, and adaptation, essential qualities for a layer that sits between your application and the hardware. Google is betting that the ecosystem will adopt this as a standard interface, much like WebGPU has become for browser-based graphics. If that bet pays off, the fragmentation that currently frustrates on-device AI development, where an optimization for NVIDIA hardware fails on AMD or Intel, begins to dissolve. Developers gain portability; users gain consistent performance regardless of their device.

One specific takeaway: watch how ML Drift handles the transition between GPU backends at runtime. The abstraction layer is only as good as its ability to preserve performance across OpenGL ES, OpenCL, Metal, and WebGPU without forcing developers to write fallback logic. If Google delivers that seamlessly, the real consequence is that on-device AI stops being a niche concern for hardware enthusiasts and becomes a default option for anyone building data-intensive applications. That is the point where your spreadsheet, running locally, can access AI inference as easily as it accesses a formula. The open question is whether the developer community will treat ML Drift as a utility or as yet another dependency to manage.

From InfoQ

Google has released ML Drift, an open-source, cross-platform GPU compute engine designed for on-device AI and machine learning inference. Licensed under Apache 2.0, it abstracts the complexities of different GPU hardware and low-level APIs, supporting OpenGL ES, OpenCL, Metal, and WebGPU.

Read the original at InfoQ