GPT Oss GitHub Repositories (2026) · Open Source Tools

[MLsys2026 Best Paper]: https://arxiv.org/abs/2506.08276. RAG on Everything with LEANN. Enjoy 97% storage savings while running a fast, accurate, and 100% private RAG application on your personal device.

A high-throughput and memory-efficient inference and serving engine for LLMs

Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.

SGLang is a high-performance serving framework for large language models and multimodal models.

🚀 Pytorch Distributed native training library for LLMs/VLMs with OOTB Hugging Face support

Run frontier LLMs and VLMs locally on Qualcomm devices across NPU, GPU, and CPU with a few lines of code