Vllm
starred
Application
A high-throughput and memory-efficient inference and serving engine for LLMs
§01 · Projects
Projects.
Filament plugins, Laravel packages and open source starter kits actively maintained. All MIT, with releases for v3, v4 and v5 where applicable.
§02 · catalogue
Webpack
starred
JavaScript Package
Packs ECMAScript/CommonJs/AMD modules for the browser. Allows you to split your codebase into multiple bundles, which can be loaded on demand. Supports loaders to preprocess files, i.e. json, jsx, es7, css, less, ... and your custom stuff.
React
ODS
starred
Docker
Turn your PC, Mac, or Linux box into an AI server. LLM inference, chat UI, voice, agents, workflows, RAG, and image generation.
Lemonade
starred
Docker
Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk
CUDA For AMD Windows
starred
Application
Run CUDA-targeted Windows applications on AMD GPUs with ZLUDA + ROCm/HIP.
§03 · contribute
Contribute, report issues, open PRs.
All packages have CI, Pest tests and open issues tagged good first issue.