Home / 🧱 AI Foundation Stack / ⚡ Inference / Serving

OpenCPIL/prima.cpp

[Official] prima.cpp: Fast 30-70B LLM inference on heterogeneous and everyday home devices