Generative Compilation: On-the-Fly Compiler Feedback as AI Generates Code

Generative Compilation: Real-time compiler feedback during LLM code generation via sealors

Researchers introduce generative compilation, a technique that provides compiler feedback on partial programs during autoregressive LLM decoding rather than only after generation completes. The core mechanism is a 'sealor'—a syntax-guided transformation that converts partial programs into complete ones that standard compilers can analyze, formally verified in Lean. Evaluated on repository-level Rust coding tasks across frontier black-box and open-weight models, the approach reduces non-compiling outputs and improves functional correctness by catching errors early and preventing error cascades. The method works without white-box model access, distinguishing it from constrained decoding approaches.