# jundot/omlx

LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar

**Commercial license**：Commercial OK — 可商用，通常只需保留著作權聲明/授權條款

**Stars**：16,432
**Source**：https://github.com/jundot/omlx