AI & ML · C · Weekly GitHub chart, Tue, Nov 17
AI & ML repositories pooled from every language chart and re-ranked by stars gained. As of Tue, Nov 17, 9 PM GMT+9.
Field
- 1
JustVugg/colibri
Hierarchical inference engine for large MoE models
colibri is a C-based inference engine that runs large mixture-of-experts models on consumer hardware. It keeps dense layers and hot experts in RAM or on a GPU while streaming cold experts from disk.
+2,306in 7 days