Vllm
por star
IA y agentes
A high-throughput and memory-efficient inference and serving engine for LLMs
Plugins Filament, paquetes Laravel y starter kits open source mantenidos activamente. Todo MIT, con releases para v3, v4 y v5 cuando aplique.
A high-throughput and memory-efficient inference and serving engine for LLMs
LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.
Todos los paquetes tienen CI y tests Pest; las issues para principiantes están marcadas con good first issue.
Nueva versión disponible.