Distributed forward proxy serversto crawl Internet via multiple cloud instances.📝 Blog 📅 Jul 20, 2015 ⏱️ 3 min readSquid HAProxy Proxy HTTP Setup Distributed
Building a scalable distributed web crawlerwhich can perform both crawling and data extraction📝 Blog 📅 Apr 18, 2015 ⏱️ 5 min readWeb Crawler Scala Akka Kafka Couchbase Jsoup Big Data Design Distributed Proxy