Home / 𧱠AI Foundation Stack / ①Inference / Serving
NightMean/OlliteRT
Turn your Android phone into an OpenAI-compatible LLM inference server β Fully local, private and Open Source
Commercial license
β Commercial OKApache-2.0
ε―εη¨οΌιεΈΈεͺιδΏηθδ½ζ¬θ²ζ/ζζ¬ζ’ζ¬Ύ
Topics
androidanthropic-apigemmahome-assistantkotlin-androidlitertlitert-lmllmllm-inferencelocal-llmon-device-aiopenai-api
Ad