AI & ML · C++ · Today's GitHub chart
AI & ML repositories pooled from every language chart and re-ranked by stars gained. As of Thu, Nov 19, 5 PM GMT+9.
- 1
microsoft/BitNet
Official inference framework for 1-bit LLMs
bitnet.cpp is the official inference framework for 1-bit LLMs such as BitNet b1.58, providing optimized kernels for fast and lossless inference on CPUs and GPUs. It delivers significant speedups and energy reductions across x86 and ARM platforms.
+325today
- 2
ggml-org/llama.cpp
C/C++ inference engine for LLMs and MLLMs
Built on top of the ggml library, llama.cpp enables LLM and MLLM inference with minimal setup across a wide range of hardware.
+306today
- 3
tensorflow/tensorflow
Open-source machine learning framework
An end-to-end open-source platform for building and deploying machine learning models. Originally developed by Google Brain, it offers an ecosystem of tools, libraries, and community resources.
+111today
- 4
incoai/splash
Local LLM inference engine for Apple silicon
Splash is a local inference engine for Apple silicon that runs coding agents and OpenAI- or Anthropic-compatible applications on a Mac. It combines DFlash 2 speculative decoding, specialized Metal kernels, and automatic memory planning.
+49today
- 5
openvinotoolkit/openvino
Open-source AI inference optimization and deployment toolkit
OpenVINO™ is an open-source toolkit for optimizing and deploying deep learning inference. It converts models from frameworks like PyTorch, TensorFlow, and ONNX so they can be deployed without the original frameworks.
+24today
- 6
carla-simulator/carla
Open-source simulator for autonomous driving research
CARLA is an open-source simulator built to support the development, training, and validation of autonomous driving systems. Alongside open-source code and protocols, it provides free digital assets such as urban layouts, buildings, and vehicles.
+20today
- 7
Neroued/ninfer
Native C++/CUDA inference engine for RTX 5090 and DGX Spark
NInfer is a native C++/CUDA inference engine for selected models such as Qwen3.6, Qwen3.8, and GLM-5.3-Flash on RTX 5090 and DGX Spark. It runs text and image/video generation through a local CLI or OpenAI- and Anthropic-compatible HTTP APIs.
+7today