| 1 |
ollama |
183918 |
18430 |
Go |
2592 |
Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models. |
2026-10-20T01:51:51Z |
| 2 |
llama.cpp |
131769 |
24580 |
C++ |
793 |
LLM inference in C/C++ |
2026-10-20T08:06:54Z |
| 3 |
vllm |
94193 |
23626 |
Python |
2660 |
A high-throughput and memory-efficient inference and serving engine for LLMs |
2026-10-20T08:24:58Z |
| 4 |
unsloth |
78295 |
7246 |
Python |
120 |
Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4, MiniMax-H3, Gemma 4, FLUX and more. |
2026-10-20T08:23:20Z |
| 5 |
LlamaFactory |
75599 |
9275 |
Python |
1008 |
Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024) |
2026-10-19T18:17:27Z |
| 6 |
llama |
59635 |
9765 |
Python |
477 |
Inference code for Llama models |
2025-01-26T21:42:26Z |
| 7 |
llama_index |
52577 |
8384 |
Python |
307 |
LlamaIndex is the document processing platform for AI |
2026-10-20T07:12:17Z |
| 8 |
LocalAI |
49761 |
4521 |
Go |
104 |
LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required. |
2026-10-20T07:28:17Z |
| 9 |
aider |
49652 |
5087 |
Python |
1406 |
aider is AI pair programming in your terminal |
2026-05-22T14:02:20Z |
| 10 |
AstrBot |
42343 |
3100 |
Python |
676 |
AI Agent Assistant & development framework that integrates lots of IM platforms, LLMs, plugins and AI feature, and can be your openclaw alternative. ✨ |
2026-10-20T06:49:41Z |
| 11 |
airllm |
39623 |
4046 |
Jupyter Notebook |
107 |
AirLLM 2.8T LLM inference with single 4GB GPU |
2026-10-20T06:19:56Z |
| 12 |
Langchain-Chatchat |
38699 |
6255 |
Python |
10 |
Langchain-Chatchat（原Langchain-ChatGLM）基于 Langchain 与 ChatGLM, Qwen 与 Llama 等语言模型的 RAG 与 Agent 应用 | Langchain-Chatchat (formerly langchain-ChatGLM), local knowledge based LLM (like ChatGLM, Qwen and Llama) RAG and Agent app with langchain |
2025-11-10T09:27:42Z |
| 13 |
khoj |
37754 |
2526 |
Python |
109 |
Your AI second brain. Self-hostable. Get answers from the web or your docs. Build custom agents, schedule automations, do deep research. Turn any online or local LLM into your personal, autonomous AI (gpt, claude, gemini, llama, qwen, mistral). Get started - free. |
2026-08-02T01:55:40Z |
| 14 |
sglang |
37469 |
9717 |
Python |
942 |
SGLang is a high-performance serving framework for large language models and multimodal models. |
2026-10-20T08:25:38Z |
| 15 |
fish-speech |
33309 |
2894 |
Python |
9 |
SOTA Open Source TTS |
2026-10-14T06:14:59Z |
| 16 |
llama3 |
29177 |
3517 |
Python |
177 |
The official Meta Llama 3 GitHub site |
2025-01-26T21:39:06Z |
| 17 |
repomix |
28922 |
1714 |
TypeScript |
114 |
📦 Repomix is a powerful tool that packs your entire repository into a single, AI-friendly file. Perfect for when you need to feed your codebase to Large Language Models (LLMs) or other AI tools like Claude, ChatGPT, DeepSeek, Perplexity, Gemini, Gemma, Llama, Grok, and more. |
2026-10-18T12:29:58Z |
| 18 |
llamafile |
26446 |
1836 |
C++ |
193 |
Distribute and run LLMs with a single file. |
2026-10-12T00:26:41Z |
| 19 |
LLaVA |
25074 |
2774 |
Python |
1098 |
[NeurIPS’23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond. |
2024-08-12T09:52:38Z |
| 20 |
Awesome-Chinese-LLM |
22772 |
2290 |
None |
13 |
整理开源的中文大语言模型，以规模较小、可私有化部署、训练成本较低的模型为主，包括底座模型，垂直领域微调及应用，数据集与教程等。 |
2026-05-10T05:03:06Z |
| 21 |
llama2.c |
20196 |
2651 |
C |
127 |
Inference Llama 2 in one file of pure C |
2024-08-06T09:44:40Z |
| 22 |
Chinese-LLaMA-Alpaca |
18930 |
2002 |
Python |
1 |
中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs) |
2026-04-19T00:58:05Z |
| 23 |
alpaca-lora |
18887 |
2165 |
Jupyter Notebook |
333 |
Instruct-tune LLaMA on consumer hardware |
2024-07-29T13:37:49Z |
| 24 |
llama-cookbook |
18568 |
2758 |
Jupyter Notebook |
23 |
Welcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started with Inference, Fine-Tuning, RAG. We also show you how to solve end to end problems using Llama model family and using them on various provider services |
2026-05-19T18:42:31Z |
| 25 |
ms-swift |
15893 |
1896 |
Python |
458 |
Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3.8, DeepSeek-V4, GLM-5.1, InternLM3, Llama4, …) and 300+ MLLMs (Qwen3-VL, Qwen3-Omni, InternVL3.5, Ovis2.5, GLM5.3, Gemma4, Llava, Phi4, …) (AAAI 2025). |
2026-10-20T05:24:08Z |
| 26 |
ChuanhuChatGPT |
15262 |
2182 |
Python |
122 |
GUI for ChatGPT API and many LLMs. Supports agents, file-based QA, GPT finetuning and query with web search. All with a neat UI. |
2026-09-16T11:44:01Z |
| 27 |
llama3-from-scratch |
15205 |
1274 |
Jupyter Notebook |
16 |
llama3 implementation one matrix multiplication at a time |
2024-05-23T14:34:05Z |
| 28 |
Llama-Chinese |
14762 |
1283 |
Python |
195 |
Llama中文社区，实时汇总最新Llama学习资料，构建最好的中文Llama大模型开源生态，完全开源可商用 |
2025-04-06T09:16:55Z |
| 29 |
langchain4j |
13267 |
2758 |
Java |
647 |
LangChain4j is an idiomatic, open-source Java library for building LLM-powered applications on the JVM. It offers a unified API over popular LLM providers and vector stores, and makes implementing tool calling (including MCP support), agents and RAG easy. It integrates seamlessly with enterprise Java frameworks like Quarkus and Spring Boot. |
2026-10-20T07:30:04Z |
| 30 |
PaddleNLP |
12979 |
3025 |
Python |
111 |
Easy-to-use and powerful LLM and SLM library with awesome model zoo. |
2026-05-23T02:54:28Z |
| 31 |
dalai |
12881 |
1310 |
CSS |
291 |
The simplest way to run LLaMA on your local machine |
2024-06-18T20:29:46Z |
| 32 |
OpenLLM |
12561 |
1007 |
Python |
6 |
Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud. |
2026-10-20T01:41:36Z |
| 33 |
YuE |
12361 |
1419 |
Python |
30 |
YuE2: frontier music generation with symbolic planning, zero-shot covers, and agentic music editing. |
2026-10-06T07:30:39Z |
| 34 |
shell_gpt |
12297 |
1067 |
Python |
89 |
A command-line productivity tool powered by AI large language models like GPT-5, will help you accomplish your tasks faster and more efficiently. |
2026-07-02T06:03:01Z |
| 35 |
bisheng |
12058 |
1980 |
Python |
12 |
BISHENG is an open LLM devops platform for next generation Enterprise AI applications. Powerful and comprehensive features include: GenAI workflow, RAG, Agent, Unified model management, Evaluation, SFT, Dataset Management, Enterprise-level System Management, Observability and more. |
2026-10-20T08:09:55Z |
| 36 |
h2ogpt |
11938 |
1295 |
Python |
292 |
Private chat with local GPT with document, images, video, etc. 100% private, Apache 2.0. Supports oLLaMa, Mixtral, llama.cpp, and more. Demo: https://gpt.h2o.ai/ https://gpt-docs.h2o.ai/ |
2025-10-09T23:30:01Z |
| 37 |
ludwig |
11775 |
1294 |
Python |
1 |
Low-code framework for building custom LLMs, neural networks, and other AI models |
2026-10-19T22:14:10Z |
| 38 |
tensorzero |
11709 |
972 |
Rust |
0 |
TensorZero is an open-source LLMOps platform that unifies an LLM gateway, observability, evaluation, optimization, and experimentation. |
2026-06-11T01:48:44Z |
| 39 |
llama-gpt |
10920 |
704 |
TypeScript |
84 |
A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support! |
2024-04-23T18:56:06Z |
| 40 |
ART |
10813 |
1009 |
Python |
80 |
Agent Reinforcement Trainer: train multi-step agents for real-world tasks using GRPO. Give your agents on-the-job training. Reinforcement learning for Qwen3.6, GPT-OSS, Llama, and more! |
2026-10-20T06:50:12Z |
| 41 |
llama-cpp-python |
10651 |
1472 |
Python |
597 |
Python bindings for llama.cpp |
2026-10-01T09:27:38Z |
| 42 |
petals |
10642 |
651 |
Python |
94 |
🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading |
2024-09-07T11:54:28Z |
| 43 |
PowerInfer |
9839 |
634 |
C++ |
126 |
High-speed Large Language Model Serving for Local Deployment |
2026-05-11T06:48:06Z |
| 44 |
oumi |
9408 |
795 |
Python |
1 |
Easily fine-tune (SFT/RL), evaluate, and deploy Qwen, Gemma, or any open agentic LLM/VLM! |
2026-10-20T00:42:56Z |
| 45 |
local-deep-research |
9366 |
876 |
Python |
1019 |
~95% on SimpleQA (e.g. Qwen3.6-27B on a 3090). Supports all local and cloud LLMs (llama.cpp, Ollama, Google, …). 10+ search engines - arXiv, PubMed, your private documents. Everything Local & Encrypted. |
2026-10-20T05:09:43Z |
| 46 |
awesome-LLM-resources |
9027 |
1028 |
None |
1 |
🧑🚀 全世界最好的LLM资料总结（多模态生成、Agent、辅助编程、AI审稿、数据处理、模型训练、模型推理、o1 模型、MCP、小语言模型、视觉语言模型） | Summary of the world’s best LLM resources. |
2026-10-07T12:48:31Z |
| 47 |
TinyLlama |
9010 |
634 |
Python |
45 |
The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens. |
2024-05-03T20:21:20Z |
| 48 |
ipex-llm |
8846 |
1433 |
Python |
1214 |
Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V, etc.) on Intel XPU (e.g., local PC with iGPU and NPU, discrete GPU such as Arc, Flex and Max); seamlessly integrate with llama.cpp, Ollama, HuggingFace, LangChain, LlamaIndex, vLLM, DeepSpeed, Axolotl, etc. |
2026-01-28T17:32:40Z |
| 49 |
Operit |
8842 |
749 |
Kotlin |
128 |
The most powerful AI agent and AI chat software on Android/Operit是一款Android上能力最为强大、发展最久的AI Agent |
2026-10-05T16:58:09Z |
| 50 |
reor |
8540 |
526 |
JavaScript |
113 |
Private & local AI personal knowledge management app for high entropy people. |
2025-05-13T21:28:59Z |
| 51 |
BELLE |
8264 |
755 |
HTML |
106 |
BELLE: Be Everyone’s Large Language model Engine（开源中文对话大模型） |
2024-10-16T11:38:59Z |
| 52 |
k8sgpt |
8260 |
1082 |
Go |
20 |
Giving Kubernetes Superpowers to everyone |
2026-10-19T14:47:02Z |
| 53 |
GPTCache |
8212 |
613 |
Python |
75 |
Semantic cache for LLMs. Fully integrated with LangChain and llama_index. |
2026-09-22T08:26:00Z |
| 54 |
lmdeploy |
8108 |
787 |
Python |
542 |
LMDeploy is a toolkit for compressing, deploying, and serving LLMs. |
2026-10-20T02:22:33Z |
| 55 |
llama-models |
7708 |
1413 |
Python |
194 |
Utilities intended for use with Llama models. |
2026-02-11T16:38:31Z |
| 56 |
open_llama |
7517 |
401 |
None |
37 |
OpenLLaMA, a permissively licensed open source reproduction of Meta AI’s LLaMA 7B trained on the RedPajama dataset |
2023-07-16T13:42:13Z |
| 57 |
mergekit |
7405 |
815 |
Python |
240 |
Tools for merging pretrained large language models. |
2026-09-12T03:24:42Z |
| 58 |
llamacoder |
7136 |
1672 |
TypeScript |
5 |
Open source Claude Artifacts – built with Llama 3.1 405B |
2026-10-15T19:36:51Z |
| 59 |
Chinese-LLaMA-Alpaca-2 |
7103 |
591 |
Python |
1 |
中文LLaMA-2 & Alpaca-2大模型二期项目 + 64K超长上下文模型 (Chinese LLaMA-2 & Alpaca-2 LLMs with 64K long context models) |
2026-04-19T00:58:50Z |
| 60 |
llm-scraper |
6944 |
474 |
TypeScript |
3 |
Turn any webpage into structured data using LLMs |
2026-09-10T01:23:00Z |
| 61 |
Liger-Kernel |
6665 |
627 |
Python |
110 |
Efficient Triton Kernels for LLM Training |
2026-10-19T20:05:34Z |
| 62 |
Firefly |
6647 |
583 |
Python |
203 |
Firefly: 大模型训练工具，支持训练Qwen2.5、Qwen2、Yi1.5、Phi-3、Llama3、Gemma、MiniCPM、Yi、Deepseek、Orion、Xverse、Mixtral-8x7B、Zephyr、Mistral、Baichuan2、Llma2、Llama、Qwen、Baichuan、ChatGLM2、InternLM、Ziya2、Vicuna、Bloom等大模型 |
2024-10-24T02:27:42Z |
| 63 |
higgsfield |
6112 |
1132 |
Jupyter Notebook |
11 |
Fault-tolerant, highly scalable GPU orchestration, and a machine learning framework designed for training models with billions to trillions of parameters |
2026-10-07T09:32:03Z |
| 64 |
lit-llama |
6080 |
517 |
Python |
100 |
Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed. |
2025-07-01T16:31:39Z |
| 65 |
LaWGPT |
6055 |
542 |
Python |
86 |
🎉 Repo for LaWGPT, Chinese-Llama tuned with Chinese Legal knowledge. 基于中文法律知识的大语言模型 |
2024-06-11T07:20:19Z |
| 66 |
OpenCursor |
6038 |
1029 |
TypeScript |
3 |
Open-source Cursor-like AI coding agent for VS Code - agentic chat, multi-provider LLMs (OpenAI, Ollama, llama.cpp), semantic search, and MCP support |
2026-09-25T08:24:32Z |
| 67 |
llama-swap |
6018 |
508 |
Go |
71 |
Reliable model swapping for any local OpenAI/Anthropic compatible server - llama.cpp, vllm, etc |
2026-10-19T18:09:09Z |
| 68 |
enchanted |
6013 |
455 |
Swift |
104 |
Enchanted is iOS and macOS app for chatting with private self hosted language models such as Llama2, Mistral or Vicuna using Ollama. |
2026-07-07T19:34:55Z |
| 69 |
shimmy |
5987 |
587 |
Rust |
9 |
⚡ Pure-Rust WebGPU inference engine — OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary. |
2026-10-19T00:54:34Z |
| 70 |
paperless-ai |
5980 |
332 |
JavaScript |
56 |
An automated document analyzer for Paperless-ngx using OpenAI API, Ollama, Deepseek-r1, Azure and all OpenAI API compatible Services to automatically analyze and tag your documents. |
2026-10-16T01:31:17Z |
| 71 |
lemonade |
5938 |
532 |
C++ |
426 |
Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk |
2026-10-20T07:42:58Z |
| 72 |
LLaMA-Adapter |
5911 |
376 |
Python |
108 |
[ICLR 2024] Fine-tuning LLaMA to follow Instructions within 1 Hour and 1.2M Parameters |
2024-03-14T08:12:53Z |
| 73 |
MedicalGPT |
5864 |
822 |
Python |
6 |
MedicalGPT: Training Your Own Medical GPT Model with ChatGPT Training Pipeline. 训练医疗大模型，实现了包括增量预训练(PT)、有监督微调(SFT)、RLHF、DPO、ORPO、GRPO。 |
2026-09-15T13:46:54Z |
| 74 |
gpustack |
5858 |
691 |
Python |
637 |
A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances. |
2026-10-20T08:14:42Z |
| 75 |
llama-fs |
5832 |
381 |
TypeScript |
53 |
A self-organizing file system with llama 3 |
2025-08-08T02:27:02Z |
| 76 |
serge |
5700 |
387 |
Svelte |
18 |
A web interface for chatting with Alpaca through llama.cpp. Fully dockerized, with an easy to use API. |
2025-11-21T08:07:36Z |
| 77 |
Baichuan-7B |
5648 |
501 |
Python |
85 |
A large-scale 7B pretraining language model developed by BaiChuan-Inc. |
2024-07-18T14:23:01Z |
| 78 |
smolvlm-realtime-webcam |
5600 |
902 |
HTML |
12 |
Real-time webcam demo with SmolVLM and llama.cpp server |
2025-05-12T17:24:39Z |
| 79 |
transformerlab-app |
5197 |
553 |
Python |
12 |
The open source research environment for AI researchers to seamlessly train, evaluate, and scale models from local hardware to GPU clusters. |
2026-10-19T18:54:18Z |
| 80 |
h2o-llmstudio |
5183 |
556 |
Python |
37 |
H2O LLM Studio - a framework and no-code GUI for fine-tuning LLMs. Documentation: https://docs.h2o.ai/h2o-llmstudio/ |
2026-10-17T11:40:29Z |
| 81 |
tiny-universe |
5116 |
477 |
Jupyter Notebook |
11 |
《大模型白盒子构建指南》：一个全手搓的Tiny-Universe |
2026-02-12T02:00:08Z |
| 82 |
Huatuo-Llama-Med-Chinese |
5000 |
516 |
Python |
28 |
Repo for BenCao [original name: HuaTuo (华驼)], Instruction-tuning Large Language Models with Chinese Medical Knowledge. 本草（原名：华驼）模型仓库，基于中文医学知识的大语言模型指令微调 |
2026-07-04T05:56:23Z |
| 83 |
PurpleLlama |
4441 |
779 |
Python |
41 |
Set of tools to assess and improve LLM security. |
2026-10-12T19:00:32Z |
| 84 |
llms-from-scratch-cn |
4418 |
608 |
Jupyter Notebook |
12 |
仅需Python基础，从0构建大语言模型；从0逐步构建GLM4\Llama3\RWKV6， 深入理解大模型原理 |
2026-09-17T03:01:54Z |
| 85 |
GPT-4-LLM |
4333 |
305 |
HTML |
13 |
Instruction Tuning with GPT-4 |
2023-06-11T13:40:30Z |
| 86 |
LightLLM |
4329 |
375 |
Python |
102 |
LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance. |
2026-10-20T08:20:07Z |
| 87 |
SwanLab |
4311 |
230 |
Python |
43 |
⚡️SwanLab - an open-source, modern-design AI training tracking and visualization tool. Supports Cloud / Self-hosted use. Integrated with PyTorch / Transformers / verl / LLaMA Factory / ms-swift / Ultralytics / MMEngine / Keras etc. |
2026-10-20T04:45:53Z |
| 88 |
llama-stack-apps |
4288 |
638 |
None |
25 |
Agentic components of the Llama Stack APIs |
2025-08-05T14:49:58Z |
| 89 |
llama_cloud_services |
4270 |
462 |
TypeScript |
349 |
Knowledge Agents and Management in the Cloud |
2026-05-18T19:09:10Z |
| 90 |
g1 |
4160 |
357 |
Python |
0 |
g1: Using Llama-3.1 70b on Groq to create o1-like reasoning chains |
2025-12-30T22:28:50Z |
| 91 |
llama3-Chinese-chat |
4137 |
328 |
Python |
29 |
Llama3-中文后训练版 |
2026-02-21T08:22:18Z |
| 92 |
langroid |
4120 |
427 |
Python |
43 |
Harness LLMs with Multi-Agent Programming |
2026-10-20T08:17:32Z |
| 93 |
llama-dl |
4105 |
392 |
Shell |
9 |
High-speed download of LLaMA, Facebook’s 65B parameter GPT model |
2023-06-28T16:56:55Z |
| 94 |
Chinese-Vicuna |
4104 |
404 |
C |
65 |
Chinese-Vicuna: A Chinese Instruction-following LLaMA-based Model —— 一个中文低资源的llama+lora方案，结构参考alpaca |
2025-04-18T02:41:35Z |
| 95 |
how-to-train-your-gpt |
4069 |
512 |
Jupyter Notebook |
3 |
Build a modern LLM from scratch. Every line commented. Explained like we are five. |
2026-08-30T22:38:02Z |
| 96 |
zero_nlp |
3842 |
444 |
Jupyter Notebook |
102 |
中文nlp解决方案(大模型、数据、模型、训练、推理) |
2025-08-05T01:26:45Z |
| 97 |
lorax |
3836 |
360 |
Python |
150 |
Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs |
2026-05-28T18:12:20Z |
| 98 |
LLamaSharp |
3814 |
515 |
C# |
17 |
A C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently. |
2026-10-17T00:15:04Z |
| 99 |
Eagle |
3712 |
361 |
Python |
62 |
Eagle: Frontier Vision-Language Models with Data-Centric Strategies |
2026-06-24T18:12:11Z |
| 100 |
llama-hub |
3456 |
717 |
Jupyter Notebook |
82 |
A library of data loaders for LLMs made by the community – to be used with LlamaIndex and/or LangChain |
2024-03-01T15:17:16Z |