Home / 🧱 AI Foundation Stack / ⚡ Inference / Serving

jmaczan/tiny-vllm

Build your own high performance LLM inference engine in C++ and CUDA - a smaller version of vLLM