Ebot: an erlang web crawler

Ebot is a opensource and scalable web crawler written on top of Erlang, a NOSQL database (Apache CouchDB or Riak), RabbitMQ, Mochiweb, Webmachine, .. See my Erlang info page for more details.