A (hopefully) distributed application for spidering the web.
A web spider written in Python. It takes a source, and spiders it for any links.
