SteerTTS

Tune Your AI Voice with Twelve Simple Number Controls

Twelve slider controls.

4 min readMachine Learning

The precision of a spreadsheet and the nuance of human speech rarely belong in the same sentence, but the open-source TTS model shared by a lone developer on Reddit this week makes a compelling argument that they should. Our take is straightforward: this is the most honest and practically useful AI voice project we have seen in months, and its limitations are as instructive as its breakthroughs. While Twenty Disrupt finalists who could reshape data, space, and life itself compete for attention on big stages, this modest 23-million-parameter model quietly solves a problem that matters to anyone building conversational AI: giving developers granular, predictable control over how their AI sounds, without requiring a data center.

The project's architecture is lean by design. A 9.6M-parameter acoustic model paired with a Vocos vocoder delivers a total footprint smaller than most image-generation models. The twelve control sliders, rate, loudness, median pitch, pitch range, final rise or fall, pauses, spectral tilt, and breathiness, are expressed as z-scores relative to the selected voice's own neutral speech. This means you can nudge a voice toward excitement or calm without retraining, and you can do it contextually during a live conversation by having an LLM adjust the parameters on the fly. The developer reports a 1.8% average word error rate on the Open TTS Leaderboard English sets, which is competitive with far larger models. Speed is also impressive: a real-time factor of 60-80 on an RTX 5070 and 4-8 on CPU, with first streamed audio arriving in about half a second.

What sets this work apart is the candid breakdown of what does not work. Loudness, pitch, and spectral tilt steer reliably. Pause duration, voicing, and CPPS controls are weak. Emotion tags behave more like style switches than independent classifiers, an emotion classifier mostly cannot tell them apart. Voice cloning similarity is low, and free-text prompts struggle with negation. The developer explicitly warns that "not fast" can come out fast. This is not a failure; it is a roadmap. For anyone who has tried to integrate a black-box TTS API only to discover that "please speak more slowly" produces sarcasm, these honest failure modes are more valuable than a polished demo. The project licenses weights under CC BY-NC 4.0 and code under MIT, which means the community can fork it, improve the weak controls, and build the training data the developer correctly identifies as the bottleneck.

The practical takeaway for our readers is immediate: if you are building voice agents, interactive assistants, or any system where tone must shift mid-conversation, this model offers a transparent, inspectable way to do it. The 2,825 built-in anonymized voices and the JSON-request structure for free-text prompts mean you can audit exactly what your AI decided to do with your instruction. The developer explicitly asks for feedback on which controls are useful and where steering feels off. That is the kind of collaboration that advances the field faster than any press release. We will be watching to see whether the weak controls tighten with more data, and whether the community treats this as a finished product or a foundation to build on. If you want to see what honest, human-centered AI development looks like, Discover how Disrupt 2026 transforms investor access to tomorrow's founders might offer one perspective, but the real story is happening on a Hugging Face page where a developer admits their emotion classifier cannot tell happiness from anger and asks for help fixing it.

From Machine Learning

I was looking for small TTS model which is steerable but couldn't find any, specially something I can adjust contextually by providing controls from LLM during a conversation. So I built one.

- RTFx ~60–80 on an RTX 5070 - ~4–8 on CPU without the optional flow refiner. First streamed audio in ~0.5 s on CPU.

Read the original at Machine Learning