Every production LLM system has retries. And nearly every one of them is broken in the same way. The pattern is familiar: your language model produces output that fails validation. Maybe it hallucinated a forbidden term, exceeded a length constraint, or violated a format requirement. So you retry. Same prompt, same constraints, same prayer to the RNGeesus that this time the dice will roll your way.<br> More
Tag: constraints
Dual-Use Constraints: Eliminating Drift in LLM Systems
When you are building real systems that rely on LLM output, you eventually face a maintenance problem: the rules you put in the prompt drift out of sync with the rules you use to validate the output. This post documents the dual-use constraints pattern, its technique, and how it works to reduce drift by using the same constraints for both purposes.<br> More