Best of CrawlingFebruary 2024

  1. 1
    Article
    Avatar of hnHacker News·2y

    Web Scraping in Python - The Complete Guide

    This post provides a comprehensive guide to web scraping in Python, including the advantages of using Python for web scraping, the best Python libraries for web scraping, and some tips and best practices for handling challenges in web scraping. It also includes code examples and recommendations for alternative libraries and tools for web scraping.

  2. 2
    Article
    Avatar of freecodecampfreeCodeCamp·2y

    How to Build a Job Board Scraper with Python

    Learn how to build a job board scraper with Python using the Pyppeteer framework. This tutorial covers the basics of web scraping and provides step-by-step instructions for extracting job listings from websites like Indeed.com. You'll also learn how to store the scraped data and clean and organize it for analysis.

  3. 3
    Article
    Avatar of communityCommunity Picks·2y

    Launching Crawlee Blog

    Apify is launching the Crawlee blog, which aims to be the best informational hub for Node.js developers interested in web scraping and automation. The blog will feature how-to tutorials, thought leadership content, Crawlee updates, and community collaboration.

  4. 4
    Article
    Avatar of hnHacker News·2y

    How to Summarize Youtube Video using ChatGPT Api and Node.js

    Learn how to summarize YouTube videos using the ChatGPT API and Node.js. The system architecture involves extracting text from YouTube videos and generating text summaries. The process includes scraping captions from YouTube videos and utilizing the OpenAI completions API. Follow the tutorial to set up the project, install necessary dependencies, scrape subtitles, split them into chunks, and generate summaries using OpenAI. Additionally, a Command Line Interface (CLI) is provided for easy use. Find the code and try it for free on Quickview.email.