📝 Crawlpod - open source scalable web crawler built on top of Scala and Akka framework. 📅 Dec 12, 2015 ⏱️ 5 min read Crawlpod Web-Crawler Scala Akka Mongodb Design Open-Source
📝 Building a scalable distributed web crawler which can perform both crawling and data extraction 📅 Apr 18, 2015 ⏱️ 5 min read Web-Crawler Scala Akka Kafka Couchbase Jsoup Big-Data Design Distributed Proxy