Built something? We create video reels & spotlights for GitHub projects.Promote your project →
Catalog / mustafaneguib / spiderbot
Public GitHub Catalog Discovered Sep 26, 2026

mustafaneguib / spiderbot

SpiderBot is a web crawler which crawls the web (HTTP servers) and retrieves content back and performs actions on the content. SpiderBot is an effort to design and develop a truly pipelined distributed Open source web crawler.

View repository on GitHub ↗ View creator profile Browse directory

About this discovery

Public repository record indexed from GitHub. Explore verified star velocity metrics, source code repositories, and curated developer tool directories across the GitHubRepo ecosystem.

#6566434GitHub System ID
mustafaneguibOrganization / User
PublicVisibility
ActiveCatalog Status

More from mustafaneguib

↗

mustafaneguib/AndroidAsync

Asynchronous socket, http (client+server), websocket, and socket.io library for android. Based on nio, not threads.

Discovered
↗

mustafaneguib/tag-augmented-reality-android

tagAugmentedReality is an open source augmented reality. This project contains an SDK (Software Development Kit) which other developers can use to build their own augmented reality projects.

Discovered
FOR MAINTAINERS

Built something? Put it in front of millions of developers.

We make a short reel about your project and post it across YouTube, Instagram, Threads, and X. Send a link, we do the rest.