Home / 🧱 AI Foundation Stack / ⚡ Inference / Serving

quantumaikr/quant.cpp

LLM inference with 7x longer context. Pure C, zero dependencies. Lossless KV cache compression + single-header library.