Hacker News·1yDatabase Relationship Diagrams Design Tool
Dbdiagram offers a free tool for developers and analysts to design database relationship diagrams using simple DSL language. The platform supports features like ER diagram creation, web-based database documentation, and defining database schemas through code. Users can benefit from a streamlined development workflow for database design and analysis.
Machine Learning Mastery·1y10 Python One-Liners for Machine Learning Modeling
Python's capability for concise one-liners can streamline the creation and evaluation of machine learning models. This guide covers ten useful one-liners, including loading data with Pandas, removing missing values, encoding categorical data, dataset splitting, model initialization and training, and cross-validation. These compact codes simplify processes such as feature scaling and pipeline building, essential for effective model development and deployment.
Baeldung·1yIntroduction to Apache Kylin
Apache Kylin is an open-source OLAP engine designed for sub-second query performance on massive datasets. Initially developed by eBay and later managed by the Apache Software Foundation, it excels in handling high concurrency and integrates seamlessly with Hadoop and data lake platforms. Key features include multidimensional modeling, optimized indexing, and support for both batch and streaming data sources. The platform can be easily explored using Docker, allowing for straightforward setup, model creation, and CUBE building via SQL and REST API.
Towards Dev·1yBuilding an End-to-End Data Lakehouse with Medalion Architecture, Airflow, and DuckDB
Learn how to build an end-to-end data lakehouse using Medalion architecture, Apache Airflow, and DuckDB. Understand the roles of the Bronze, Silver, and Gold layers in managing data quality and transformation. Discover why Apache Airflow is ideal for orchestrating workflows and how DuckDB serves as a high-performance analytical database for data warehousing.
Daily Dose of Data Science | Avi Chawla | Substack·1y[Hands-on] Build a Multi-agent Brand Monitoring System
Learn how to build a brand monitoring app using Bright Data for web scraping, CrewAI for orchestration, and Ollama for serving DeepSeek-R1 locally. The app scrapes data from various platforms (e.g., X, Instagram, YouTube), analyzes it, and generates insights through platform-specific Crews, ultimately producing a comprehensive report.
Data Engineering·1yData Engineering Vault: 1000+ Interconnected Concepts for Data Engineers
The Data Engineering Vault is a curated collection of over 1,000 interconnected concepts designed to form a comprehensive knowledge base for data engineers. It includes detailed notes on the data engineering lifecycle, various data modeling approaches, modern data infrastructure, data transformation paradigms, analytics, and specialized techniques. The vault offers interconnected learning paths, historical context, practical applications, and recommendations for essential resources and thought leaders in the field.
Tinybird·1ydbt in real-time
Tinybird offers an alternative to dbt for real-time analytics, simplifying the process of migrating API use cases from dbt. It provides built-in support for real-time processing, API endpoint creation, and simplifies the tech stack by consolidating all data operations. Tinybird uses ClickHouse for faster performance, especially for API responses. Migrating involves mapping dbt concepts to Tinybird equivalents, such as materialized views for incremental updates, and creating optimized data source schemas.
Machine Learning News·1yComplete Guide: Working with CSV/Excel Files and EDA in Python
This tutorial provides a comprehensive guide to working with CSV/Excel files and performing exploratory data analysis (EDA) using Python. It covers importing, cleaning, and preprocessing data, exploring data through statistics and visualization, and deriving insights from business data using libraries such as pandas, NumPy, matplotlib, and seaborn. The guide uses a realistic e-commerce dataset to demonstrate the entire workflow, including merging datasets and handling data quality issues.
YouTube·1ySQL Full Course for Beginners (30 Hours) – From Zero to Hero
The course, led by Barzalini, covers SQL from the basics to advanced techniques including window functions, stored procedures, and database optimization. Suitable for data engineers, analysts, scientists, and students, it offers extensive materials and is entirely free. The training includes step-by-step instructions, animated visuals for complex concepts, and practical projects such as data warehousing and analytics.