Vllm
favorisiert
Anwendung
A high-throughput and memory-efficient inference and serving engine for LLMs
§01 · Projekte
Projekte.
Aktiv gepflegte Filament-Plugins, Laravel-Pakete und Open-Source-Starter-Kits. Alle MIT, mit Releases für v3, v4 und v5, sofern zutreffend.
§02 · katalog
Webpack
favorisiert
JavaScript-Paket
Packs ECMAScript/CommonJs/AMD modules for the browser. Allows you to split your codebase into multiple bundles, which can be loaded on demand. Supports loaders to preprocess files, i.e. json, jsx, es7, css, less, ... and your custom stuff.
React
ODS
favorisiert
Docker
Turn your PC, Mac, or Linux box into an AI server. LLM inference, chat UI, voice, agents, workflows, RAG, and image generation.
Lemonade
favorisiert
Docker
Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk
CUDA For AMD Windows
favorisiert
Anwendung
Run CUDA-targeted Windows applications on AMD GPUs with ZLUDA + ROCm/HIP.
§03 · mitwirken
Beitragen, Issues melden, PRs öffnen.
Alle Pakete haben CI, Pest-Tests und offene Issues mit dem Tag good first issue.