Benders Decomposition

From Infeasibility to Insight with Farkas' Lemma

Infeasibility in optimization isn't a dead end; it's a signal.

3 min readTowards Data Science
From Infeasibility to Insight with Farkas' Lemma

Most people treat an infeasible model the way they treat a dead end: a red light, a stop sign, a reason to turn around. But the real lesson of Benders decomposition, especially when feasibility cuts enter the picture, is that a dead end is just data. Farkas' lemma is the quiet engine behind this idea, using the capacitated facility location problem to show how a solver can learn from "no solution" rather than merely report it. That is a genuinely useful reframe. It is also a reminder that the most powerful tools in optimization are not the ones that avoid failure, but the ones that mine failure for structure.

We have written before about how Exploring Paragraph Structure: How LLMs Navigate Token Space shows LLMs treating token positions as coordinates, and how Bridging Retrieval and Action: A New Approach to AI Tasks connects retrieval to action. The through-line here is the same: progress comes from making the implicit explicit. In the LLM case, the coordinate system reveals itself through paragraph structure. In the retrieval case, connecting two separate systems forces you to name the gap between them. Feasibility cuts do the same thing for optimization. They force the model to say, in precise mathematical language, *why* a candidate solution fails, and that explanation becomes a new constraint. The model is not just solving the problem; it is rewriting the problem as it learns.

What makes this practical is that Benders decomposition, at its core, is a division of labor. The master problem makes a guess, the subproblem stress-tests it, and the feasibility cut is the feedback loop that says, "Here is the direction in which you are wrong." For anyone working with real-world logistics, network design, or capacity planning, this is not an academic curiosity. It is the difference between a model that returns a crisp "infeasible" and one that returns a path forward. That is a meaningful distinction. A model that can learn from infeasibility is not just more robust; it is more honest about the constraints it operates under.

Our take is simple. If you are using decomposition methods and skipping feasibility cuts because they feel like error handling, you are leaving information on the table. The mechanics are explained, but more importantly, infeasibility is demonstrated as a signal worth treating with the same respect as optimality. The concrete point to watch: next time your solver says "infeasible," ask it for a Farkas certificate. That single habit will change how you debug models, and it will make your optimization practice far more resilient. The math has been there all along; the question is whether you are ready to listen to it.

From Towards Data Science

Learning about Farkas' lemma and how it can inform Benders decomposition to learn from infeasibility, applied to the capacitated facility location problem.

The post How Benders Decomposition Works, Part II: Feasibility Cuts appeared first on Towards Data Science.

Read the original at Towards Data Science