Vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
Plugins Filament, paquetes Laravel y starter kits open source mantenidos activamente. Todo MIT, con releases para v3, v4 y v5 cuando aplique.
A high-throughput and memory-efficient inference and serving engine for LLMs
Packs ECMAScript/CommonJs/AMD modules for the browser. Allows you to split your codebase into multiple bundles, which can be loaded on demand. Supports loaders to preprocess files, i.e. json, jsx, es7, css, less, ... and your custom stuff.
Turn your PC, Mac, or Linux box into an AI server. LLM inference, chat UI, voice, agents, workflows, RAG, and image generation.
Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk
Run CUDA-targeted Windows applications on AMD GPUs with ZLUDA + ROCm/HIP.
Todos los paquetes tienen CI, tests Pest e issues abiertas marcadas con good first issue.
Nueva versión disponible.