Scrapy - Scrapy | A Fast and Powerful Scraping and Web Crawling Framework
HTTrack - HTTrack is a free (GPL, libre/free software) and easy-to-use offline browser utility.
StormCrawler - StormCrawler is an open source SDK for building distributed web crawlers with Apache Storm.
GNU Wget - GNU Wget is a free software package for retrieving files using HTTP(S) and FTP, the most...
Apache Nutch - Apache Nutch is a highly extensible and scalable open source web crawler software project.
WebCopy - Cyotek WebCopy is a free tool for copying full or partial websites locally onto your harddisk for offline viewing.