Vllm
starred
AI & agents
A high-throughput and memory-efficient inference and serving engine for LLMs
Filament plugins, Laravel packages and open source starter kits actively maintained. All MIT, with releases for v3, v4 and v5 where applicable.
All packages have CI and Pest tests; beginner-friendly issues are tagged good first issue.
New version available.