top of page

Agenty https://www.agenty.com

Beautiful Soup https://www.crummy.com/software/BeautifulSoup/bs4/do

c

Big Data Made Simple http://bigdata-madesimple.com/top-50-open-sourceweb-

crawlers-for-data-mining

Cola https://github.com/chineking/cola

Content Bomb http://www.contentbomb.com

Connotate https://www.connotate.com

Common Crawl https://commoncrawl.org

Crawly http://crawly.diffbot.com

Crawl Monster https://www.crawlmonster.com

Cyotek WebCopy https://www.cyotek.com/cyotek-webcopy

Data Miner https://data-miner.io

Demiurge https://github.com/matiasb/demiurge

Dexi.io https://dexi.io

DiffBot https://www.diffbot.com

FMiner http://www.fminer.com

Getleft https://sourceforge.net/projects/getleftdown

Grabby https://grabby.io

Helium Scraper http://www.heliumscraper.com/en/index.php?p=home

HTTrack https://www.httrack.com

Import.io https://www.import.io

Lassie https://github.com/michaelhelmick/lassie

Listly https://listly.io

213

Mechanical Soup https://github.com/MechanicalSoup/MechanicalSoup

Octoparse https://www.octoparse.com

Open Data Tools http://opendata-tools.org/en/data

OutWit Docs http://www.outwit.com/products/docs

OutWit Hub http://www.outwit.com/products/hub

Parsehub https://www.parsehub.com

Portia https://scrapinghub.com/portia

Pyspider https://github.com/binux/pyspider

Reaper https://reaper.social ||

https://github.com/ScriptSmith/reaper/blob/master/READ

ME.md

Scraper https://chrome.google.com/webstore/detail/scraper/mbig

bapnjcgaffohmbkdlecaccepngjd

Scraper Wiki https://scraperwiki.com

Scrapy https://scrapy.org

Screen Scraper https://www.screen-scraper.com

Sitebulb https://sitebulb.com

UiPath https://www.uipath.com/community

Web Harvy https://www.webharvy.com

Webhose.io https://webhose.io

Web Scraper http://webscraper.io

80 Legs http://80legs.com

bottom of page