Building a scalable distributed web crawlerwhich can perform both crawling and data extraction📝 Blog 📅 Apr 18, 2015 ⏱️ 5 min readWeb Crawler Scala Akka Kafka Couchbase Jsoup Big Data Design Distributed Proxy