📝Distributed forward proxy serversto crawl Internet via multiple cloud instances.📅 Jul 20, 2015 ⏱️ 3 min readSquid Haproxy Proxy Http Setup Distributed
📝Building a scalable distributed web crawlerwhich can perform both crawling and data extraction📅 Apr 18, 2015 ⏱️ 5 min readWeb-Crawler Scala Akka Kafka Couchbase Jsoup Big-Data Design Distributed Proxy