Filament plugins, Laravel packages and open source starter kits actively maintained. All MIT, with releases for v3, v4 and v5 where applicable.
🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
A high-throughput and memory-efficient inference and serving engine for LLMs
Port of OpenAI's Whisper model in C/C++
Fully automatic censorship removal for language models
Faster Whisper transcription with CTranslate2
MNN: A blazing-fast, lightweight inference engine battle-tested by Alibaba, powering high-performance on-device LLMs and Edge AI.
FreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently.
Train a tiny Transformer from scratch on your iMessage history, entirely on your Mac.
All packages have CI, Pest tests and open issues tagged good first issue.
New version available.
