Ollama
favorisiert
Docker
Get up and running with Kimi-K2.6, GLM-5.2, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
§01 · Projekte
Projekte.
Aktiv gepflegte Filament-Plugins, Laravel-Pakete und Open-Source-Starter-Kits. Alle MIT, mit Releases für v3, v4 und v5, sofern zutreffend.
§02 · katalog
Transformers
favorisiert
Anwendung
🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
FreeToken
favorisiert
Anwendung
FreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently.
Neutronstar
favorisiert
Anwendung
Giant MoE models on a single consumer GPU by streaming experts from SSD. CUDA fork of antirez/ds4: runs GLM-5.2 (743B), Tencent Hy3 (295B), and DeepSeek 4 Flash, with io_uring expert streaming, LFU host cache, cross-layer expert prefetch, and the first MTP speculative decoding for GLM-5.2.
§03 · mitwirken
Beitragen, Issues melden, PRs öffnen.
Alle Pakete haben CI, Pest-Tests und offene Issues mit dem Tag good first issue.