Community Picks

Learn how to find real-life coding projects for your portfolio. Get inspiration for web design, web scraping, data analytics, Chrome extensions, and full-stack applications.

Coding project IDEAS for portfolio

KDnuggets

Discover some essential Python libraries for data engineers, including Requests for API data extraction, BeautifulSoup for web scraping, Pandas for data manipulation, SQLAlchemy for database work, Airflow for workflow orchestration, PySpark for big data processing, and Kafka-Python for real-time data processing.

7 Python Libraries Every Data Engineer Should Know

Earthly

Learn how to scrape websites with Python using Beautiful Soup and Selenium. Extract data from static pages with Beautiful Soup and navigate dynamic pages with Selenium.

Python Web Scraping with Beautiful Soup and Selenium

Explore web crawling and web scraping techniques for extracting data from websites. Learn about crawling algorithms, web scraping tools, and ethical considerations. Whether you're a data scientist, researcher, or web developer, there's  content here to help you gather and analyze data from the web.

Best of Crawling — April 2024