AI & ML · C++ · Today's GitHub chart

AI & ML repositories pooled from every language chart and re-ranked by stars gained. As of Thu, Nov 19, 5 PM GMT+9.

  1. 1

    microsoft/BitNet

    Official inference framework for 1-bit LLMs

    bitnet.cpp is the official inference framework for 1-bit LLMs such as BitNet b1.58, providing optimized kernels for fast and lossless inference on CPUs and GPUs. It delivers significant speedups and energy reductions across x86 and ARM platforms.

    C++42.1k starsAI & ML

    +325today

  2. 2

    ggml-org/llama.cpp

    C/C++ inference engine for LLMs and MLLMs

    Built on top of the ggml library, llama.cpp enables LLM and MLLM inference with minimal setup across a wide range of hardware.

    C++135.7k stars1 good first issueAI & ML

    +306today

  3. 3

    tensorflow/tensorflow

    Open-source machine learning framework

    An end-to-end open-source platform for building and deploying machine learning models. Originally developed by Google Brain, it offers an ecosystem of tools, libraries, and community resources.

    C++201.6k starsAI & ML

    +111today

  4. 4

    incoai/splash

    Local LLM inference engine for Apple silicon

    Splash is a local inference engine for Apple silicon that runs coding agents and OpenAI- or Anthropic-compatible applications on a Mac. It combines DFlash 2 speculative decoding, specialized Metal kernels, and automatic memory planning.

    C++2.4k starsAI & ML

    +49today

  5. 5

    openvinotoolkit/openvino

    Open-source AI inference optimization and deployment toolkit

    OpenVINO™ is an open-source toolkit for optimizing and deploying deep learning inference. It converts models from frameworks like PyTorch, TensorFlow, and ONNX so they can be deployed without the original frameworks.

    C++11.4k stars1 good first issueAI & ML

    +24today

  6. 6

    carla-simulator/carla

    Open-source simulator for autonomous driving research

    CARLA is an open-source simulator built to support the development, training, and validation of autonomous driving systems. Alongside open-source code and protocols, it provides free digital assets such as urban layouts, buildings, and vehicles.

    C++14.6k starsAI & ML

    +20today

  7. 7

    Neroued/ninfer

    Native C++/CUDA inference engine for RTX 5090 and DGX Spark

    NInfer is a native C++/CUDA inference engine for selected models such as Qwen3.6, Qwen3.8, and GLM-5.3-Flash on RTX 5090 and DGX Spark. It runs text and image/video generation through a local CLI or OpenAI- and Anthropic-compatible HTTP APIs.

    C++3.4k starsAI & ML

    +7today