Home / 🧱 AI Foundation Stack / ⚡ Inference / Serving

avifenesh/bw24

From-scratch Rust+CUDA inference engine, bit-exact by construction — NVFP4, MoE, MTP speculative decoding, tuned against measured limits of one RTX 5090 Laptop (sm_120a).