AI & ML · C++ · Daily GitHub chart, Wed, Nov 18
AI & ML repositories pooled from every language chart and re-ranked by stars gained. As of Wed, Nov 18, 6 AM GMT+9.
Field
- 1
Helldez/BigMoeOnEdge
Streaming inference engine for oversized MoE models
A llama.cpp-based inference engine that runs Mixture-of-Experts models larger than device memory by streaming needed experts from flash storage. It includes desktop and mobile apps alongside an OpenAI- and Anthropic-compatible local server.
+46that day