
LoopCache speeds up long‑context decoding in Looped Transformers
Researchers introduce LoopCache, a technique that removes stale speculation in looped transformers and cuts compute for long‑context generation.
Try in Readerlooped transformersself‑speculative decodingkv cachelong context