Best of Data Analysis — 2025

1. 1
   Video

   ByteGrad·1y

   SQL Tutorial - All 38 Concepts You Need To Know

   SQL is a structured query language used to manage and analyze data in databases. Understanding SQL concepts is valuable for both organizations and individual careers. Key SQL concepts include creating and managing databases, tables, and relationships, as well as performing queries to insert, update, delete, and retrieve data. Proper data structuring, using primary and foreign keys, and employing joins are essential for database efficiency. Indexing can optimize queries, and using transactions ensures data consistency. Tools and certifications like those offered by DataCamp can enhance SQL skills.

   327

   1
2. 2
   Video

   Tech With Tim·1y

   I Built a Web Scraping AI Agent From Scratch - It's Insane...

   Building powerful AI applications requires the integration of large language models (LLMs) with real-time data and useful tools. In this post, the author demonstrates the development of an AI travel agent using Python. This agent uses Bright Data APIs for real-time travel data, Google Flights, and hotel information to provide relevant and current recommendations. The post covers the project's architecture, details the steps of web scraping with automated browsers, and explains how the AI processes and combines data to generate personalized travel plans.

   233

   2
3. 3
   Article

   Daily Dose of Data Science | Avi Chawla | Substack·1y

   Pandas Mind Map

   A detailed mind map of various Pandas methods categorized by their operation types, including I/O methods, DataFrame creation, statistical information, renaming, plotting, time-series, grouping, pivot, and categorical data methods. Additional ML resources and techniques are also provided for developing industry-relevant skills.

   195

   5
4. 4
   Article

   Lonely Programmer·44w

   How SQL works....

   156

   3
5. 5
   Video

   YouTube·1y

   8 Insane AI Agent Use Cases in N8N! (automate anything)

   Explore eight diverse AI agent use cases with n8n, ranging from data analysis to creating viral shorts. Learn how AI agents can automate tasks, enhance workflows, and provide insights across various domains. This post highlights practical examples and how the AI Foundations community can help you build and implement these agents efficiently.

   156

   1
6. 6
   Article

   Hacker News·1y

   Database Relationship Diagrams Design Tool

   Dbdiagram offers a free tool for developers and analysts to design database relationship diagrams using simple DSL language. The platform supports features like ER diagram creation, web-based database documentation, and defining database schemas through code. Users can benefit from a streamlined development workflow for database design and analysis.

   152

   6
7. 7
   Article

   DuckDB·1y

   The DuckDB Local UI

   DuckDB, in collaboration with MotherDuck, has introduced a built-in local UI available starting from DuckDB v1.2.1. This UI can be launched via terminal or a SQL command and offers features such as interactive notebooks, a column explorer, and detailed table summaries. It runs all queries locally, ensuring data privacy unless explicitly connected to MotherDuck. The UI is designed to be simple, fast, feature-rich, and fully open source.

   133

   7
8. 8
   Article

   Database Daily·1y

   Visualizing a SQL query

   122

   1
9. 9
   Article

   Code Like A Girl·30w

   Learning to Be Okay With Not Knowing Everything

   The data analytics field requires continuous learning rather than mastery of everything. Success comes from embracing curiosity over certainty, learning in layers rather than all at once, and focusing on relevant skills instead of chasing every trend. The imposter feeling is normal, and even experienced professionals regularly search for answers. Progress matters more than perfection, and being comfortable with not knowing everything is essential for sustainable growth in data careers.

   108

   8
10. 10
    Article

    Machine Learning Mastery·1y

    10 Python One-Liners for Machine Learning Modeling

    Python's capability for concise one-liners can streamline the creation and evaluation of machine learning models. This guide covers ten useful one-liners, including loading data with Pandas, removing missing values, encoding categorical data, dataset splitting, model initialization and training, and cross-validation. These compact codes simplify processes such as feature scaling and pipeline building, essential for effective model development and deployment.

    88

    3
11. 11
    Article

    Hacker News·1y

    superglue-ai/superglue: superglue is an API connector that writes its own code. It lets you connect to any API/data source and get the data you want in the format you need.

    Superglue is an open-source API connector that automates the process of connecting to various APIs and data sources. It handles pagination, authentication, error retries, and transforms response data into desired schemas using JSONata expressions. Users can deploy superglue on their infrastructure and configure API calls easily. It also supports flexible authentication methods, smart pagination, schema validation, and caching.

    88

    1
12. 12
    Article

    Machine Learning Mastery·51w

    10 Python One-Liners That Will Simplify Feature Engineering

    Ten practical Python one-liners for feature engineering tasks including standardization, min-max scaling, polynomial features, one-hot encoding, discretization, logarithmic transformation, ratio creation, low variance removal, multiplicative interactions, and outlier tracking. Each technique uses popular libraries like scikit-learn and pandas to transform raw data into meaningful features for machine learning models.

    82
13. 13
    Article

    Towards Data Science·44w

    I Analysed 25,000 Hotel Names and Found Four Surprising Truths

    A data scientist analyzed 25,000 hotel names worldwide using the Hotel Data API to uncover why hotels are named after cities they're not located in. The study revealed that Paris is the most borrowed city name (1,100+ hotels), followed by Vienna and Rome. Three main reasons emerged: proximity for search visibility, branding to evoke luxury and sophistication, and historical tradition dating back to 18th-century aristocratic travel patterns. The analysis used Python, pandas, and geographic distance calculations to map naming patterns across countries.

    72

    5
14. 14
    Article

    Baeldung·1y

    Introduction to Apache Kylin

    Apache Kylin is an open-source OLAP engine designed for sub-second query performance on massive datasets. Initially developed by eBay and later managed by the Apache Software Foundation, it excels in handling high concurrency and integrates seamlessly with Hadoop and data lake platforms. Key features include multidimensional modeling, optimized indexing, and support for both batch and streaming data sources. The platform can be easily explored using Docker, allowing for straightforward setup, model creation, and CUBE building via SQL and REST API.

    63
15. 15
    Article

    Tinybird·1y

    Run Tinybird on your own infrastructure

    Tinybird Self-Managed is now available in beta, allowing users to deploy Tinybird's real-time data platform on their own AWS infrastructure, with support for GCP and Azure coming soon. This version provides greater control over data environments, integrating with private data sources and optimizing hardware resources as needed. Future updates will include expanded cloud support, automated upgrades, and advanced monitoring.

    54
16. 16
    Video

    YouTube·1y

    SQL Data Warehouse from Scratch | Full Hands-On Data Engineering Project

    Learn how to build a modern SQL data warehouse from scratch, incorporating real-world practices used in companies like Mercedes-Benz. The project covers data architecture design, ETL processes, and data modeling basics. By the end, you'll have a professional portfolio project to showcase your skills.

    54
17. 17
    Article

    Hacker News·31w

    Comparing the power consumption of a 30 year old refrigerator to a brand new one

    A comparison of power consumption between a 30-year-old UPO Jääkarhu refrigerator and a modern replacement using smart plug monitoring. The old unit consumed 2.6 kWh daily versus 0.7 kWh for the new one—a 3.7x difference. Monthly savings of approximately 57 kWh translate to a payback period of about 38 months at 17 cents per kWh. The analysis demonstrates practical IoT monitoring applications for home energy optimization and appliance replacement decisions.

    51

    5
18. 18
    Video

    Oxylabs·1y

    Building a Real Estate Monitoring System

    Alex discusses building a real estate monitoring system, focusing on the types of data that can be extracted from real estate websites, the use cases for the extracted data including price comparisons and market trends, and the challenges faced such as getting fresh data, overcoming anti-bot measures, and scaling the system. He then advises using Oxylabs' Real Estate Scraper API to handle these challenges efficiently.

    50
19. 19
    Article

    Javarevisited·1y

    How to Learn Data Analytics in 2025? (with Resources)

    Data analytics is a highly sought-after skill in 2025, offering competitive salaries and diverse opportunities across industries. To master this field, it's recommended to use a combination of reading books, watching online tutorials and courses, doing projects, joining bootcamps, and gaining real-world experience. Google offers two key certificate programs on Coursera: the Google Data Analytics Professional Certificate for beginners and the Google Advanced Data Analytics Certificate for those looking to dive deeper. These programs cover essential skills such as data cleaning, statistical analysis, data visualization, and SQL. Additionally, platforms like DataCamp and Kaggle can further enhance your learning experience.

    43

    1
20. 20
    Article

    DuckDB·50w

    Faster Dashboards with Multi-Column Approximate Sorting

    Advanced multi-column sorting techniques using space filling curves (Morton and Hilbert encodings) and truncated timestamps can significantly improve query performance on columnar data formats. These methods enable approximate sorting across multiple columns simultaneously, allowing diverse dashboard queries to benefit from min-max indexes and row group pruning. Experiments on flight data show Hilbert encoding provides the most consistent performance across different query patterns, while sorting by truncated timestamps (year-level granularity) combined with Hilbert encoding works best for time-filtered queries.

    42
21. 21
    Article

    Cloudflare·30w

    From .com to .anything: introducing Top-Level Domain (TLD) insights on Cloudflare Radar

    Cloudflare Radar launched a new Top-Level Domain (TLD) insights page that provides comprehensive data on TLD popularity, traffic patterns, and security metrics. The page uses DNS Magnitude—a metric measuring how many unique networks query domains within a TLD—to rank over 2,500 TLDs. Surprisingly, .su (Soviet Union's legacy TLD) tops the ranking due to queries from a popular online game. Individual TLD pages offer detailed information including DNSSEC support, RDAP availability, DNS query volumes, certificate issuance data, and geographic distribution. The feature extends existing DNS insights to all delegated TLDs and integrates with Cloudflare Registrar for domain registration. All data is accessible via API and the Radar Data Explorer.

    41
22. 22
    Article

    Towards Dev·1y

    Building an End-to-End Data Lakehouse with Medalion Architecture, Airflow, and DuckDB

    Learn how to build an end-to-end data lakehouse using Medalion architecture, Apache Airflow, and DuckDB. Understand the roles of the Bronze, Silver, and Gold layers in managing data quality and transformation. Discover why Apache Airflow is ideal for orchestrating workflows and how DuckDB serves as a high-performance analytical database for data warehousing.

    40

    1
23. 23
    Article

    80 LEVEL·23w

    Steam: $16B+ in 2025, Nearly Half of 19,000 Games Got Under 10 Reviews

    Steam generated over $16.2 billion in revenue during the first eleven months of 2025, marking its strongest year ever. However, nearly half of the 19,000 games released on the platform received fewer than 10 reviews, indicating severe discoverability challenges. Only 6.2% of releases surpassed 500 reviews, a threshold for broader visibility. The data reveals a platform thriving commercially through a small number of successful titles while the majority of games struggle to gain traction, creating a difficult environment for smaller developers.

    37

    12
24. 24
    Article

    Daily Dose of Data Science | Avi Chawla | Substack·1y

    [Hands-on] Build a Multi-agent Brand Monitoring System

    Learn how to build a brand monitoring app using Bright Data for web scraping, CrewAI for orchestration, and Ollama for serving DeepSeek-R1 locally. The app scrapes data from various platforms (e.g., X, Instagram, YouTube), analyzes it, and generates insights through platform-specific Crews, ultimately producing a comprehensive report.

    36
25. 25
    Article

    Lonely Programmer·38w

    SQL Query Analysis

    32

    1