Nanbeige4.3-33B

Nanbeige4.3-33B opens Apache 2.0 access to power smaller, smarter agents

Nanbeige4.3-33B is now open under Apache 2.0, and the numbers tell a focused story. On Terminal-Bench 2.1, it scores 80.9 against Qwen3-8-27B's 73.0, though it trails 60.3 to 61.7 on SWE-Bench Pro. The team positions…

4 min readMachine Learning

The Nanbeige4.3-33B release is an important step forward for open-weight agentic AI, but the headline benchmark numbers deserve a cooler read than the hype cycle usually delivers. The team reports an 80.9 on Terminal-Bench 2.1 against Qwen3.8-27B's 73.0, yet on SWE-Bench Pro the scores flip slightly in the other direction: 60.3 versus 61.7. These are the releasing team's own evaluations, not independent replication, and the model is positioned explicitly as a teacher for smaller agents, including a planned 3B model. That matters more than the raw leaderboard position. This release fits a pattern we are seeing across the ecosystem: Google's ML Drift Opens On-Device AI to Any GPU Environment and the growing presence of agentic systems at major conferences like NeurIPS show that the real competition is shifting from raw parameter counts to practical deployment efficiency. Nanbeige is playing that game directly.

The practical detail that deserves your attention is the `preserve_thinking=true` setting used in the agent evaluations. The model card recommends this for multi-turn tool use but not for general chat. That is a meaningful caveat. If you compare task success and total generated tokens with that setting held fixed, you get a much more useful picture than treating the headline scores as a deployment ranking. The 33B teacher model is Apache 2.0, the context window is 512K, and the weights are available now. That combination means any team with a GPU can start experimenting with agent workflows without licensing friction. The honest question is whether the evaluation methodology matches your own use case. If your agents handle long, multi-turn tool sequences, the Nanbeige numbers are relevant. If you are running short, single-turn queries, the comparison is less informative.

What makes this release strategically interesting is the explicit teacher-student framing. Nanbeige is not trying to win every benchmark with the 33B model; it is training a 3B agent that will inherit the reasoning patterns. That is a bet on distillation and small-model viability, not on brute-force scaling. The open-weight Apache 2.0 license means the community can replicate, fine-tune, and audit that distillation process. Compare that to the 14.8B model that speaks DNA and English in a single chat we covered recently: domain-specific models are becoming viable at sizes that would have seemed impractical two years ago. The same logic applies here. A well-distilled 3B agent that scores near a 33B teacher on agentic tasks is more useful for on-device or low-latency deployment than any single large model sitting in a cloud API.

The open question that matters most is reproducibility. These are the releasing team's evaluations, and the Terminal-Bench score advantage is notable, but the SWE-Bench Pro result shows the model does not dominate everywhere. When the 3B student arrives, the community should run its own head-to-head comparisons with the same harness and the same `preserve_thinking` setting. That is the specific detail to watch: whether the distillation holds up under independent testing, or whether the teacher's advantage comes from inference-time tricks that do not transfer to the smaller model.

From Machine Learning

Nanbeige released Nanbeige4.3-33B as the teacher for its planned smaller agents, including an upcoming 3B model. the weights are Apache 2.0, and the model card lists a 512K context window.

the team reports 80.9 on Terminal-Bench 2.1 versus 73.0 for Qwen3.8-27B, using the same harness and inference settings within each benchmark. it does not win everywhere. on SWE-Bench Pro, the reported scores are 60.3 versus 61.7. these are the releasing team's evaluations, not independent replication.

Read the original at Machine Learning