How are trending GitHub repositories ranked on GitHubRepo?

Repositories are ranked using an algorithmic velocity score combining 24-hour and 7-day star growth snapshots, fork acceleration, open issue resolution, and developer engagement telemetry.

How frequently are trending open source repositories updated?

Telemetry snapshots and rankings are recalculated continuously, with new daily leaderboards and video spotlight reels published on a strict 4-hour cycle.

How can developers promote their open source project?

Maintainers can claim their repository growth kit, embed live SVG star history badges in their README, or apply for spotlight video reels across YouTube, Instagram, Threads, and X.

Home / Topics / web-crawling

Topic Catalog

Top WEB-CRAWLING GitHub Repositories & Tools (2026)

Discover the most starred and trending open source tools tagged with #web-crawling.

SPONSORED BY

Kishan Kanani

Design & product building

Interviewly

Job search tools for developers

+ Advertise here

Your product in front of developers

+ Promote project

Get a video reel for your repo

2 matching projects · updated Sep 28, 2026 How we rank ↗

#1 TRENDING lexmount/moli Rust NEW 2026

Best headless browser for AI agents. Lite, Fast, High-Compatibility. Built in Rust

◇ ai-agents ◇ ai-tools ◇ browser ◇ browser-automation

162 ↑ +31 today

2.5K

#2 TRENDING unclecode/crawl4ai Python 2024

Open-source web crawler and scraper for LLMs and AI agents: any website into clean, LLM-ready Markdown. Run it yourself, or use Crawl4AI Cloud with one key.

◇ ai ◇ ai-agents ◇ crawler ◇ data-extraction

8.7K ↑ +25 today

84.3K

From our network

Top WEB-CRAWLING GitHub Repositories & Tools (2026)

Built something? Put it in front of millions of developers.