Llama3 GitHub Repositories (2026) · Open Source Tools

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

Efficient Triton Kernels for LLM Training

🚀 Pytorch Distributed native training library for LLMs/VLMs with OOTB Hugging Face support

A simple, performant, and scalable Jax LLM!

Agents-flex is A lightweight Java AI agent development framework (positioned as a counterpart to Spring AI). It supports features such as RAG, MCP, Skills, Text2SQL , LLM Wiki, Sub-agents, Web Search, TTS (synchronous and streaming), and STT.

Java Inference Tornado toolkit: High performance LLM inference & serving for the JVM on GPUs

Run frontier LLMs and VLMs locally on Qualcomm devices across NPU, GPU, and CPU with a few lines of code

A C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.

Distributed LLM inference. Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.