Discover the best Data open source repositories on GitHub. Explore trending tools, live star counts, source code, and developer projects updated daily.
🕷️ The BEST Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev
LlamaIndex is the document processing platform for AI
Pluggable data replication with checkpointing, batching, and integrity events
Scalable data pre processing and curation toolkit for LLMs
data load tool (dlt) is an open source Python library that makes data loading easy 🛠️
Prefect is a workflow orchestration framework for building resilient data pipelines in Python.
The home of the CUE language! Validate and define text-based and dynamic configuration
Add a real-time analytics node to your operational database. Spice is a portable, accelerated SQL query, search, and LLM-inference engine in Rust for data-grounded AI apps and agents.
A configuration as code language with rich validation and tooling.
Interactive Tables and Data Grids for JavaScript
Communication infrastructure for the AI era — one binary, one broker, one storage layer, any protocol
The fastest business intelligence tool for humans and agents.
Machine learning with dataframes
🤖 Powerful asynchronous state management, server-state utilities and data fetching for the web. TS/JS, React Query, Solid Query, Svelte Query and Vue Query.
OpenDota: Open source Dota 2 data platform with automated replay parsing
A library for building rich, web-based geospatial 2D & 3D data platforms.
The official home of the Presto distributed SQL query engine for big data
The National Gallery of Art Open Data Program
Backend that powers the dataset viewer on Hugging Face dataset pages through a public API.
The most advanced ORM of JVM, for both java & kotlin