Ollama
favorisiert
Docker
Get up and running with Kimi-K2.6, GLM-5.2, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
§01 · Projekte
Projekte.
Aktiv gepflegte Filament-Plugins, Laravel-Pakete und Open-Source-Starter-Kits. Alle MIT, mit Releases für v3, v4 und v5, sofern zutreffend.
§02 · katalog
Transformers
favorisiert
Anwendung
🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
Vllm
favorisiert
Anwendung
A high-throughput and memory-efficient inference and serving engine for LLMs
Unsloth
favorisiert
Docker
Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4, MiniMax-H3, Gemma 4, FLUX and more.
OmniRoute
favorisiert
Docker
Unified AI router with 356 providers, RTK+Caveman compression, auto fallback, MCP/A2A, desktop, PWA, and OpenAI-compatible APIs.
Tailwind
React
9router
favorisiert
Docker
9Router web dashboard
Tailwind
React
FreeToken
favorisiert
Anwendung
FreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently.
Lemonade
favorisiert
Docker
Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk
Code
favorisiert
Anwendung
Tools for repo-wide maintenance.
Mtplx
favorisiert
Anwendung
3x faster speeds on MLX | Qwen 3.8 27B | Native MTP Speculative Decoding On Apple Silicon With No External Drafter.
§03 · mitwirken
Beitragen, Issues melden, PRs öffnen.
Alle Pakete haben CI, Pest-Tests und offene Issues mit dem Tag good first issue.