Mykhailo Kushnir has created a python script that can scrape 90% of websites for free. He uses a dockerized version of Selenium and chromedriver for stability. The script can be used to scrape good-old quotes.toscrape.com. The result is stored in a CSV file.

3m read timeFrom levelup.gitconnected.com
Post cover image
Table of contents
How I scrape lots of sites with one python scriptTypes of data that can be scrapedThe process of scraping a websiteHow to use the script to scrape websitesTips on how to improve your scraping processVoice of the crowd

Sort: