magicdog/urlfilter
filter url by bdb. bloom and tair
Developer Profile
magicdog
Discovered public repositories for magicdog in the GitHub catalog.
magicdog/scrapyextract
extract url from index sites using scrapy framework
magicdog/dmozextract
this project is used to extract url from dmoz site.
magicdog/urlmerge
using merge algo to merge large amount of url
magicdog/urlseed
find news home page by analysis page contents.
magicdog/hipupagerender
page render modified by weijian.
magicdog/leveldb
Public repository.
magicdog/natty
NATTY
magicdog/heritrix3
heritrix3
magicdog/algorithm
Complement the basic algorithm based on 'Introduction to Algorithms'.