Vllm
favorisiert
Anwendung
A high-throughput and memory-efficient inference and serving engine for LLMs
§01 · Projekte
Projekte.
Aktiv gepflegte Filament-Plugins, Laravel-Pakete und Open-Source-Starter-Kits. Alle MIT, mit Releases für v3, v4 und v5, sofern zutreffend.
§02 · katalog
Whisper Cpp
favorisiert
Anwendung
Port of OpenAI's Whisper model in C/C++
Faster Whisper
favorisiert
Anwendung
Faster Whisper transcription with CTranslate2
Ncnn
favorisiert
Mobile-Bibliothek
ncnn is a high-performance neural network inference framework optimized for the mobile platform
FreeToken
favorisiert
Anwendung
FreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently.
Llmaz
favorisiert
Docker
☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!
PaddleOCR Ncnn CPP
favorisiert
Anwendung
C++ implementations of PP-OCRv3/4/5/6 using ncnn for inference.
Hal0
favorisiert
Docker
Open-source self-hosted home AI inference platform for AMD Strix Halo — multi-backend slots, OpenAI-compatible gateway, Vue 3 + FastAPI + systemd.
§03 · mitwirken
Beitragen, Issues melden, PRs öffnen.
Alle Pakete haben CI, Pest-Tests und offene Issues mit dem Tag good first issue.