Home / 🧱 AI Foundation Stack / ⚑ Inference / Serving

marchinthesun/EPYC-Max-Inference-LLM-Optimizer

LLM Optimizer for NUMA, and monitor LLM system

🧱 AI Foundation Stack βœ“ Commercial OK β˜… 105TypeScript

Commercial license

βœ“ Commercial OKMIT

ε―ε•†η”¨οΌŒι€šεΈΈεͺιœ€δΏη•™θ‘—δ½œζ¬Šθ²ζ˜Ž/授權撝款

Topics

amd-epycamd-threadripperbare-metalcpu-cachecpu-monitoringcpuinfoddr5epychardware-topologyhigh-performance-computinghpc-systemshugepages
Ad