Best of Crawling — June 2025

  1. 1
    Video
    Avatar of TechWithTimTech With Tim·49w

    Python Advanced AI Agent Tutorial - LangGraph, LangChain, Tools & More!

    A comprehensive tutorial on building advanced AI agents using LangGraph, LangChain, and Firecrawl. The guide demonstrates creating a coding research assistant that follows structured multi-step workflows to research developer tools and frameworks. It covers both simple agent creation using MCP servers and advanced implementations with custom workflows, structured outputs using Pydantic models, and controlled agent flow through graph-based state management.

  2. 2
    Article
    Avatar of n8nn8n·49w

    I created 100 nodes company scrapper n8n automation

    A comprehensive business intelligence automation workflow built with n8n that combines Google Maps Places API scraping, automated SEO analysis, AI-powered online influence rating, and LinkedIn employee data extraction. The system creates detailed company profiles by gathering location data, website information, SEO scores, and employee details, outputting everything to Google Sheets for lead generation purposes.

  3. 3
    Article
    Avatar of theregisterThe Register·49w

    Bots are overwhelming websites with their hunger for AI data

    AI bots are overwhelming cultural institutions' websites with aggressive data harvesting for training purposes. A GLAM-E Labs survey of 43 organizations found that 39 experienced increased traffic, with 27 attributing it to AI bots. These bot swarms are causing service outages and unsustainable costs for galleries, libraries, archives, and museums. Traditional defenses like robots.txt files are proving ineffective, while bot protection services from AWS and Cloudflare offer some relief. The report calls for AI companies to develop more responsible data collection methods.

See all Crawling archives