AI & ML · C++ · Daily GitHub chart, Tue, Nov 17
AI & ML repositories pooled from every language chart and re-ranked by stars gained. As of Tue, Nov 17, 9 PM GMT+9.
Field
- 1
Helldez/BigMoeOnEdge
Streaming inference engine for oversized MoE models
A llama.cpp-based inference engine that runs Mixture-of-Experts models larger than device memory by streaming needed experts from flash storage. It includes desktop and mobile apps alongside an OpenAI- and Anthropic-compatible local server.
+98that day