Data & databases · Monthly GitHub chart, Wed, Nov 18

Data & databases repositories pooled from every language chart and re-ranked by stars gained. As of Wed, Nov 18, 6 AM GMT+9.

  1. 1

    D4Vinci/Scrapling

    Python web scraping and crawling framework

    Scrapling is a Python web scraping framework that combines fast HTTP requests, stealth browsers, element parsing, and concurrent crawling in one library. It handles everything from single-page extraction to full-scale spiders with proxy rotation and pause/resume.

    Python104.3k starsData & databases

    +15,971in 30 days

  2. 2

    gosom/google-maps-scraper

    Open-source Google Maps data scraper

    An open-source scraper that extracts over 33 data points from Google Maps, including business names, addresses, phone numbers, websites, ratings, reviews, coordinates, and emails. It runs via CLI, Web UI, REST API, or an AI agent skill compatible with tools like Claude Code.

    Go8.2k starsData & databases

    +1,651in 30 days

  3. 3

    ModernRelay/omnigraph

    Object-storage native graph database with branching

    Omnigraph is a Rust-based graph database built on object storage and the open Lance format, providing a typed ontology and unified retrieval engine for AI agents. It decouples storage and compute across local disk or S3-compatible backends.

    Rust3.1k starsData & databases

    +1,471in 30 days

  4. 4

    redis/redis

    In-memory cache, data structure server, and vector query engine

    Redis is an in-memory cache, data structure server, and document and vector query engine for real-time data-driven applications. It provides low-latency operations across multiple data types along with search and messaging capabilities.

    C77.5k starsData & databases

    +1,033in 30 days

  5. 5

    elastic/elasticsearch

    Distributed search and analytics engine

    Elasticsearch is a distributed search and analytics engine, scalable data store, and vector database built for production-scale workloads. It supports near real-time search over large datasets, vector search, and integration with generative AI applications.

    Java78.7k stars1 good first issueData & databases

    +624in 30 days

  6. 6

    tigerbeetle/tigerbeetle

    Financial transactions database for safety and performance

    TigerBeetle is an OLTP financial transactions database written in Zig, designed for mission-critical safety and performance. It centers on debit and credit primitives with a local storage engine and global consensus protocol.

    Zig17.4k stars1 good first issueData & databases

    +233in 30 days

  7. 7

    trinodb/trino

    Distributed SQL query engine for big data analytics

    Trino is a fast distributed SQL query engine for big data analytics. Formerly known as PrestoSQL, it is written in Java.

    Java13.5k stars1 good first issueData & databases

    +193in 30 days

  8. 8

    groue/GRDB.swift

    SQLite database toolkit for Swift application development

    A toolkit for storing permanent application data in SQLite databases in Swift. It provides model-based SQL generation and fetching while also allowing direct access to raw SQL when needed.

    Swift8.8k starsData & databases

    +67in 30 days