KirtiRamchandani / memory.cpp

What it does

Coding agents are long-horizon: they rebuild tool traces, file summaries, test output, and repeated intent across many turns. A large prompt can be technically valid yet still be wasteful, stale, unsafe, and impossible to cache. That waste shows up as repeated prefill work, larger attention state, lower prompt-cache reuse, more memory pressure per request, and — worst of all — wrong patches when old docs and prior failed attempts leak into context.