| 1 |
vllm |
89482 |
20937 |
Python |
2165 |
A high-throughput and memory-efficient inference and serving engine for LLMs |
2026-08-20T03:52:42Z |
| 2 |
LlamaFactory |
74241 |
9078 |
Python |
995 |
Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024) |
2026-08-18T11:49:47Z |
| 3 |
sglang |
32133 |
8035 |
Python |
803 |
SGLang is a high-performance serving framework for large language models and multimodal models. |
2026-08-20T03:54:40Z |
| 4 |
colibri |
25524 |
2768 |
C |
60 |
Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦 |
2026-08-20T01:59:58Z |
| 5 |
ms-swift |
15301 |
1614 |
Python |
545 |
Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3.6, DeepSeek-V4, GLM-5.1, InternLM3, Llama4, …) and 300+ MLLMs (Qwen3-VL, Qwen3-Omni, InternVL3.5, Ovis2.5, GLM4.5v, Gemma4, Llava, Phi4, …) (AAAI 2025). |
2026-08-20T01:46:24Z |
| 6 |
TensorRT-LLM |
14422 |
2677 |
Python |
647 |
TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way. |
2026-08-20T03:23:50Z |
| 7 |
flashinfer |
6194 |
1307 |
Python |
301 |
FlashInfer: Kernel Library for LLM Serving |
2026-08-20T03:35:49Z |
| 8 |
MoeKoeMusic |
6134 |
394 |
Vue |
1 |
一款开源简洁高颜值的酷狗第三方客户端 An open-source, concise, and aesthetically pleasing third-party client for KuGou that supports Windows / macOS / Linux / Web :electron: |
2026-08-19T03:10:39Z |
| 9 |
kimi-k3-in-c |
6110 |
1004 |
C |
11 |
A 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS, no framework, no GPU. |
2026-08-07T16:39:26Z |
| 10 |
Bangumi |
5852 |
168 |
TypeScript |
28 |
:electron: An unofficial https://bgm.tv ui first app client for Android and iOS, built with React Native. 一个无广告、以爱好为驱动、不以盈利为目的、专门做 ACG 的类似豆瓣的追番记录，bgm.tv 第三方客户端。为移动端重新设计，内置大量加强的网页端难以实现的功能，且提供了相当的自定义选项。 目前已适配 iOS / Android。 |
2026-08-19T08:29:26Z |
| 11 |
xtuner |
5178 |
444 |
Python |
241 |
A Next-Generation Training Engine Built for Ultra-Large MoE Models |
2026-08-20T03:10:11Z |
| 12 |
trace.moe |
5019 |
262 |
None |
0 |
Timestamp Retrieval for Anime Clips Everywhere |
2026-08-09T08:11:21Z |
| 13 |
fastllm |
4931 |
485 |
C++ |
301 |
fastllm是后端无依赖的高性能大模型推理库。同时支持张量并行推理稠密模型和混合模式推理MOE模型，任意10G以上显卡即可推理满血DeepSeek。双路9004/9005服务器+单显卡部署DeepSeek满血满精度原版模型，单并发20tps；INT4量化模型单并发30tps，多并发可达60+。 |
2026-08-20T03:39:25Z |
| 14 |
GLM-4.5 |
4412 |
470 |
Python |
26 |
GLM-4.5: Agentic, Reasoning, and Coding (ARC) Foundation Models |
2026-02-01T08:28:10Z |
| 15 |
Moeditor |
4110 |
263 |
JavaScript |
106 |
(discontinued) Your all-purpose markdown editor. |
2020-07-07T01:08:32Z |
| 16 |
flash-moe |
4077 |
509 |
Objective-C |
10 |
Running a big model on a small laptop |
2026-03-19T17:21:57Z |
| 17 |
Moe-Counter |
3019 |
295 |
JavaScript |
3 |
Moe counter badge with multiple themes! - 多种风格可选的萌萌计数器 |
2026-04-16T03:39:37Z |
| 18 |
moemail |
2790 |
2565 |
TypeScript |
50 |
A cute temporary email service built with NextJS + Cloudflare technology stack 🎉 | 一个基于 NextJS + Cloudflare 技术栈构建的可爱临时邮箱服务🎉 |
2026-07-30T14:09:33Z |
| 19 |
MoeGoe |
2425 |
242 |
Python |
28 |
Executable file for VITS inference |
2023-08-22T07:17:37Z |
| 20 |
MoE-LLaVA |
2321 |
138 |
Python |
65 |
【TMM 2025🔥】 Mixture-of-Experts for Large Vision-Language Models |
2025-07-15T07:59:33Z |
| 21 |
MoBA |
2166 |
158 |
Python |
12 |
MoBA: Mixture of Block Attention for Long-Context LLMs |
2025-04-03T07:28:06Z |
| 22 |
ICEdit |
2102 |
111 |
Python |
23 |
[NeurIPS 2025] Image editing is worth a single LoRA! 0.1% training data for fantastic image editing! Surpasses GPT-4o in ID persistence~ MoE ckpt released! Only 4GB VRAM is enough to run! |
2025-12-19T19:08:02Z |
| 23 |
DeepSeek-MoE |
1967 |
309 |
Python |
18 |
DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Models |
2024-01-16T12:18:10Z |
| 24 |
fastmoe |
1858 |
206 |
Python |
25 |
A fast MoE impl for PyTorch |
2025-02-10T06:04:33Z |
| 25 |
OpenMoE |
1694 |
86 |
Python |
6 |
A family of open-sourced Mixture-of-Experts (MoE) Large Language Models |
2024-03-08T15:08:26Z |
| 26 |
paimon-moe |
1525 |
283 |
JavaScript |
315 |
Your best Genshin Impact companion! Help you plan what to farm with ascension calculator and database. Also track your progress with todo and wish counter. |
2026-08-12T14:48:38Z |
| 27 |
uccl |
1493 |
169 |
C++ |
57 |
UCCL is an efficient communication library for GPUs, covering collectives, P2P (e.g., KV cache transfer, RL weight transfer), and EP (e.g., GPU-driven) |
2026-08-19T17:54:56Z |
| 28 |
SpikingBrain-7B |
1368 |
189 |
Python |
9 |
Spiking Brain-inspired Large Models, integrating hybrid efficient attention, MoE modules and spike encoding into its architecture |
2026-05-14T09:52:16Z |
| 29 |
moepush |
1359 |
423 |
TypeScript |
15 |
一个基于 NextJS + Cloudflare 技术栈构建的可爱消息推送服务, 支持多种消息推送渠道✨ |
2025-05-10T11:42:44Z |
| 30 |
MOE |
1321 |
139 |
C++ |
170 |
A global, black box optimization engine for real world metric optimization. |
2023-03-24T11:00:32Z |
| 31 |
SmartImage |
1313 |
79 |
C# |
5 |
Reverse image search tool (SauceNao, IQDB, Ascii2D, trace.moe, and more) |
2026-08-09T00:10:31Z |
| 32 |
mixture-of-experts |
1251 |
112 |
Python |
6 |
PyTorch Re-Implementation of “The Sparsely-Gated Mixture-of-Experts Layer” by Noam Shazeer et al. https://arxiv.org/abs/1701.06538 |
2024-04-19T08:22:39Z |
| 33 |
diy-llm |
1224 |
124 |
Jupyter Notebook |
0 |
🎓 系统性大语言模型构建课程｜🛠️ 覆盖预训练数据工程、Tokenizer、Transformer、MoE、GPU 编程 (CUDA/Triton)、分布式训练、Scaling Laws、推理优化及对齐 (SFT/RLHF/GRPO)｜🚀 6 个渐进式作业 + 代码驱动，建立 LLM 全栈认知体系 |
2026-08-19T03:43:57Z |
| 34 |
MoeMemosAndroid |
1154 |
130 |
Kotlin |
96 |
An app to help you capture thoughts and ideas |
2026-07-16T16:28:13Z |
| 35 |
MiniMind-in-Depth |
1147 |
89 |
None |
6 |
轻量级大语言模型MiniMind的源码解读，包含tokenizer、RoPE、MoE、KV Cache、pretraining、SFT、LoRA、DPO等完整流程 |
2025-06-16T14:13:15Z |
| 36 |
Uni-MoE |
1116 |
71 |
Python |
27 |
Uni-MoE: Lychee’s Large Multimodal Model Family. |
2026-08-06T10:50:45Z |
| 37 |
Aria |
1087 |
89 |
Jupyter Notebook |
32 |
Codebase for Aria - an Open Multimodal Native MoE |
2025-01-22T03:25:37Z |
| 38 |
K3Flight |
1017 |
1 |
HTML |
1 |
Run Kimi K3 locally on CPU with ~55GB measured runtime RAM. A single-file Linux inference server powered by cPilot Runtime. |
2026-07-31T11:04:00Z |
| 39 |
Tutel |
1010 |
110 |
C |
55 |
Tutel MoE: Optimized Mixture-of-Experts Library, Support GptOss/DeepSeek/Kimi-K2/Qwen3 using FP8/NVFP4/MXFP4 |
2026-08-10T02:10:42Z |
| 40 |
llama-moe |
1001 |
61 |
Python |
6 |
⛷️ LLaMA-MoE: Building Mixture-of-Experts from LLaMA with Continual Pre-training (EMNLP 2024) |
2024-12-06T04:47:07Z |
| 41 |
Time-MoE |
991 |
115 |
Python |
14 |
[ICLR 2025 Spotlight] Official implementation of “Time-MoE: Billion-Scale Time Series Foundation Models with Mixture of Experts” |
2026-03-21T16:00:55Z |
| 42 |
MoeTTS |
990 |
73 |
None |
0 |
Speech synthesis model /inference GUI repo for galgame characters based on Tacotron2, Hifigan, VITS and Diff-svc |
2023-03-03T07:30:05Z |
| 43 |
moebius |
961 |
54 |
JavaScript |
40 |
Modern ANSI & ASCII Art Editor |
2024-05-02T15:54:35Z |
| 44 |
cudnn-frontend |
910 |
254 |
Python |
78 |
cuDNN Frontend is NVIDIA’s modern, open-source entry point to the cuDNN library and a growing collection of high-performance open-source kernels. |
2026-08-20T00:39:40Z |
| 45 |
MoeMemos |
862 |
75 |
Swift |
77 |
An app to help you capture thoughts and ideas |
2026-08-01T01:32:47Z |
| 46 |
Adan |
822 |
70 |
Python |
6 |
Adan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Models |
2025-06-08T14:35:41Z |
| 47 |
Hunyuan-A13B |
816 |
117 |
Python |
35 |
Tencent Hunyuan A13B (short as Hunyuan-A13B), an innovative and open-source LLM built on a fine-grained MoE architecture. |
2025-07-08T08:45:27Z |
| 48 |
DeepSeek-671B-SFT-Guide |
812 |
97 |
Python |
1 |
An open-source solution for full parameter fine-tuning of DeepSeek-V3/R1 671B, including complete code and scripts from training to inference, as well as some practical experiences and conclusions. (DeepSeek-V3/R1 满血版 671B 全参数微调的开源解决方案，包含从训练到推理的完整代码和脚本，以及实践中积累一些经验和结论。) |
2025-03-13T03:51:33Z |
| 49 |
MoePeek |
807 |
54 |
Swift |
8 |
A lightweight macOS selection translator built with pure Swift 6, featuring on-device Apple Translate for privacy, only 5MB install size and stable ~50MB memory usage. 一款轻量级 macOS 划词翻译工具，纯 Swift 6 开发，设备端 Apple 翻译保护隐私，安装体积仅 5MB，后台运行内存稳定约 50MB |
2026-08-13T06:23:54Z |
| 50 |
moe-theme.el |
774 |
68 |
Emacs Lisp |
15 |
A customizable colorful eye-candy theme for Emacser. Moe, moe, kyun! |
2026-08-19T15:54:08Z |
| 51 |
MixtralKit |
770 |
76 |
Python |
11 |
A toolkit for inference and evaluation of ‘mixtral-8x7b-32kseqlen’ from Mistral AI |
2023-12-15T19:10:55Z |
| 52 |
sonic-moe |
747 |
97 |
Python |
10 |
Accelerating MoE with IO and Tile-aware Optimizations |
2026-08-17T07:50:26Z |
| 53 |
SwiftLM |
741 |
50 |
Swift |
4 |
⚡ Native MLX Swift LLM inference server for Apple Silicon. OpenAI-compatible API, SSD streaming for 100B+ MoE models, TurboQuant KV cache compression, MACOS + iOS iPhone app. |
2026-08-16T17:01:53Z |
| 54 |
moe |
721 |
35 |
Nim |
41 |
A command line based editor inspired by Vim. Written in Nim. |
2026-08-17T13:35:49Z |
| 55 |
YOLO-Master |
682 |
142 |
Python |
26 |
[CVPR2026]🚀🚀🚀Official code for the paper “YOLO-Master: MOE-Accelerated with Specialized Transformers for Enhanced Real-time Detection.” (YOLO = You Only Look Once) 🔥🔥🔥 |
2026-08-20T03:29:02Z |
| 56 |
Awesome-Mixture-of-Experts-Papers |
670 |
49 |
None |
3 |
A curated reading list of research in Mixture-of-Experts(MoE). |
2024-10-30T07:48:14Z |
| 57 |
pegainfer |
653 |
102 |
Rust |
107 |
Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2 |
2026-08-19T21:06:17Z |
| 58 |
moedict-webkit |
651 |
98 |
Objective-C |
1 |
萌典網站 |
2026-08-14T03:36:14Z |
| 59 |
MoeList |
643 |
23 |
Kotlin |
25 |
Another unofficial Android MAL client |
2026-08-09T08:38:47Z |
| 60 |
vtbs.moe |
638 |
36 |
Vue |
34 |
Virtual YouTubers in bilibili |
2025-07-31T13:39:09Z |
| 61 |
satania.moe |
617 |
54 |
HTML |
3 |
Satania IS the BEST waifu, no really, she is, if you don’t believe me, this website will convince you |
2022-10-09T23:19:01Z |
| 62 |
Chinese-Mixtral |
612 |
43 |
Python |
0 |
中文Mixtral混合专家大模型（Chinese Mixtral MoE LLMs） |
2026-04-19T00:59:54Z |
| 63 |
moebius |
608 |
42 |
Elixir |
3 |
A functional query tool for Elixir |
2024-10-23T18:55:45Z |
| 64 |
moebooru |
605 |
80 |
Ruby |
30 |
Moebooru, a fork of danbooru1 that has been heavily modified |
2026-08-12T18:34:47Z |
| 65 |
BitSoulStockSkill |
578 |
50 |
Python |
0 |
由BitSoul出品的A股市场全能Skill，自带免费历史数据，内置100+行业主流因子，完整的回测框架，基于MOE架构的股票筛选与买卖判断，更提供因子挖矿等趣味接口，欢迎安装试用，也欢共同开发交流！ |
2026-03-21T08:19:00Z |
| 66 |
MoeGoe_GUI |
572 |
69 |
C# |
8 |
GUI for MoeGoe |
2023-08-22T07:32:08Z |
| 67 |
trace.moe-telegram-bot |
559 |
78 |
TypeScript |
0 |
This Telegram Bot can tell the anime when you send an screenshot to it |
2026-08-20T00:45:30Z |
| 68 |
mixture-of-kittens |
550 |
66 |
Python |
3 |
Mixture-of-experts (MoE) training megakernel for NVL72s |
2026-08-14T03:44:18Z |
| 69 |
moerail |
542 |
42 |
JavaScript |
22 |
铁路车站代码查询 × 动车组交路查询 |
2025-08-13T12:55:25Z |
| 70 |
LPLB |
528 |
43 |
Python |
1 |
An early research stage expert-parallel load balancer for MoE models based on linear programming. |
2025-11-19T07:20:35Z |
| 71 |
vLLM-Moet |
526 |
49 |
Sass |
11 |
A vLLM patch + hand‑written SM120 SASS kernels: 2‑bit MoE experts + an FP4 “delta” cache that recovers precision — matching the official (NV)FP4 checkpoint’s quality on consumer Blackwell cards |
2026-08-14T11:04:41Z |
| 72 |
Moebius |
516 |
44 |
Python |
2 |
[ECCV 2026] Moebius: 0.2B Lightweight Image Inpainting Framework with 10B-Level Performance |
2026-08-12T03:16:36Z |
| 73 |
step_into_llm |
480 |
127 |
Jupyter Notebook |
27 |
MindSpore online courses: Step into LLM |
2025-12-22T11:46:46Z |
| 74 |
FreeMoe |
452 |
8 |
None |
15 |
Unlock App Vip |
2026-01-30T05:50:54Z |
| 75 |
MoeSR |
441 |
13 |
JavaScript |
8 |
An application specialized in image super-resolution for ACGN illustrations and Visual Novel CG. 专注于插画/Galgame CG等ACGN领域的图像超分辨率的应用 |
2026-08-10T15:16:16Z |
| 76 |
Lvllm |
441 |
39 |
Python |
2 |
LvLLM is a special NUMA extension of vllm that makes full use of CPU and memory resources, reduces GPU memory requirements, and features an efficient GPU parallel and NUMA parallel architecture, supporting hybrid inference for MOE large models. |
2026-08-19T07:39:50Z |
| 77 |
apex-quant |
439 |
30 |
Shell |
11 |
Adaptive Precision for EXpert Models: MoE-aware mixed-precision quantization |
2026-08-17T09:15:33Z |
| 78 |
eLLM |
438 |
43 |
Rust |
3 |
eLLM can infer LLM on CPUs faster than on GPUs |
2026-08-17T07:23:13Z |
| 79 |
DiT-MoE |
437 |
20 |
Python |
7 |
Scaling Diffusion Transformers with Mixture of Experts |
2024-09-09T02:12:12Z |
| 80 |
moe-sticker-bot |
428 |
70 |
Go |
39 |
A Telegram bot that imports LINE/kakao stickers or creates/manages new sticker set. |
2024-06-06T15:28:28Z |
| 81 |
MOE |
422 |
79 |
Java |
18 |
Make Opensource Easy - tools for synchronizing repositories |
2022-06-20T22:41:08Z |
| 82 |
awesome-moe-inference |
420 |
18 |
None |
0 |
Curated collection of papers in MoE model inference |
2026-03-12T01:59:19Z |
| 83 |
MoeLoaderP |
415 |
28 |
C# |
12 |
🖼二次元图片下载器 Pics downloader for booru sites,Pixiv.net,Bilibili.com,Konachan.com,Yande.re , behoimi.org, safebooru, danbooru,Gelbooru,SankakuComplex,Kawainyan,MiniTokyo,e-shuushuu,Zerochan,WorldCosplay ,Yuriimg etc. |
2025-05-19T13:20:58Z |
| 84 |
hydra-moe |
415 |
16 |
Python |
10 |
None |
2023-11-02T22:53:15Z |
| 85 |
Awesome-Efficient-Arch |
406 |
33 |
None |
0 |
Speed Always Wins: A Survey on Efficient Architectures for Large Language Models |
2025-11-11T09:47:37Z |
| 86 |
nmoe |
396 |
33 |
Python |
2 |
MoE training for Me and You and maybe other people |
2026-03-15T22:23:47Z |
| 87 |
ARIS-in-AI-Offer |
391 |
16 |
Python |
3 |
Bilingual (中文+EN) ML / LLM / diffusion / agent interview cheat sheets for AI 秋招 — generated by ARIS /interview-cheatsheet, rendered by /render-html into single-file HTML, reads anywhere — plus a CV→DBLP-fact-checked academic homepage generator and hand-authored long-form blogs 🌱 |
2026-08-18T03:28:49Z |
| 88 |
st-moe-pytorch |
387 |
35 |
Python |
4 |
Implementation of ST-Moe, the latest incarnation of MoE after years of research at Brain, in Pytorch |
2024-06-17T00:48:47Z |
| 89 |
BigMoeOnEdge |
381 |
38 |
C++ |
14 |
Run MoE models bigger than your RAM. A 284B on a 12 GB phone, CPU only, lossless, on stock llama.cpp |
2026-08-17T16:35:36Z |
| 90 |
WThermostatBeca |
372 |
70 |
C++ |
4 |
Open Source firmware replacement for Tuya Wifi Thermostate from Beca and Moes with Home Assistant Autodiscovery |
2023-08-26T22:10:38Z |
| 91 |
pixiv.moe |
370 |
41 |
TypeScript |
0 |
😘 A pinterest-style layout site, shows illusts on pixiv.net order by popularity. |
2023-03-08T06:54:34Z |
| 92 |
MOEAFramework |
361 |
130 |
Java |
1 |
A Free and Open Source Java Framework for Multiobjective Optimization |
2026-01-21T16:26:02Z |
| 93 |
ds4-on-spark |
358 |
25 |
Shell |
0 |
Entrpi/ds4, a Blackwell CUDA perf fork of antirez/ds4 on NVIDIA DGX Spark: one-command install, ~3x upstream prefill, ~1.5x decode, DSpark, and full continuous batch support |
2026-08-19T04:21:20Z |
| 94 |
zeraix |
354 |
13 |
TypeScript |
0 |
Open-source local AI workspace — advancing on-device inference. |
2026-08-17T10:21:12Z |
| 95 |
notify.moe |
353 |
46 |
Go |
86 |
:dancer: Anime tracker, database and community. Moved to https://git.akyoto.dev/web/notify.moe |
2022-09-26T07:15:05Z |
| 96 |
soft-moe-pytorch |
348 |
10 |
Python |
4 |
Implementation of Soft MoE, proposed by Brain’s Vision team, in Pytorch |
2025-04-02T12:47:40Z |
| 97 |
dialogue.moe |
344 |
10 |
Python |
1 |
None |
2022-12-14T14:50:38Z |
| 98 |
MoE-Infinity |
343 |
34 |
Python |
4 |
PyTorch library for cost-effective, fast and easy serving of MoE models. |
2026-08-19T17:38:13Z |
| 99 |
pith-train |
337 |
33 |
Python |
4 |
Compact and Agent-Native MoE Training System |
2026-07-31T00:27:52Z |
| 100 |
kimi-k3-mlx |
336 |
40 |
Python |
14 |
MLX port of moonshotai/Kimi-K3 (2.78T multimodal MoE): streaming converter, REAP expert pruning, and per-language expert-overlap analysis |
2026-08-01T20:36:39Z |