Why Cache Reasoning as Code?
Instead of having an LLM reason from scratch every time, crystallize each inference into code and cache it. A JIT-compiler-like structure that calls the LLM only on a cache miss, and what it achieves over time.
Instead of having an LLM reason from scratch every time, crystallize each inference into code and cache it. A JIT-compiler-like structure that calls the LLM only on a cache miss, and what it achieves over time.