搜索项目

搜索 "gguf" 找到 2 个结果

Shimmy
Shimmy

⚡ Python-free Rust inference server — OpenAI-API compatible. GGUF + SafeTensors, hot model swap, auto-discovery, single

3/5 1980
api-server command-line-tool developer-tools
Off Grid

The Swiss Army Knife of Offline AI. Chat, Speak, and Generate Images - Privacy First, Zero Internet. Download an LLM and

3/5 804
edge-ai gguf llama-cpp