Airllm
AirLLM 70B inference with single 4GB GPU
Filament plugins, Laravel packages and open source starter kits actively maintained. All MIT, with releases for v3, v4 and v5 where applicable.
AirLLM 70B inference with single 4GB GPU
The official firmware for Meshtastic, an open-source, off-grid mesh communication system.
The cryptography-based networking stack for building unstoppable networks with LoRa, Packet Radio, WiFi and everything in between.
Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.
Instruct LLMs for flat and nested NER. Fine-tuning Llama and Mistral models for instruction named entity recognition. (Instruction NER)
All packages have CI, Pest tests and open issues tagged good first issue.
New version available.