Best of Database — 2025

  1. 1
    Article
    Avatar of gcgitconnected·1y

    Backend Developer Roadmap 2025: The Complete Guide

    This guide outlines the essential skills and timelines needed to become a proficient backend developer by 2025. It covers core topics such as programming languages (with a focus on Node.js), databases, APIs, version control, web servers, authentication, and deployment. The guide includes a free roadmap template with project ideas and a progress tracker to help you stay on course.

  2. 2
    Video
    Avatar of fireshipFireship·1y

    I replaced my entire tech stack with Postgres...

    Modern web development often involves using multiple tools, leading to high costs and complexity. However, PostgreSQL, a powerful relational database, can handle many tasks typically outsourced to other services. It offers advanced data types, support for unstructured data, extensions for cron jobs, in-memory caching, vector storage, GraphQL, real-time syncing, authentication, analytics, and more. The post emphasizes critically choosing the right tools and showcases how PostgreSQL can simplify full stack application development.

  3. 3
    Video
    Avatar of bytegradByteGrad·1y

    SQL Tutorial - All 38 Concepts You Need To Know

    SQL is a structured query language used to manage and analyze data in databases. Understanding SQL concepts is valuable for both organizations and individual careers. Key SQL concepts include creating and managing databases, tables, and relationships, as well as performing queries to insert, update, delete, and retrieve data. Proper data structuring, using primary and foreign keys, and employing joins are essential for database efficiency. Indexing can optimize queries, and using transactions ensures data consistency. Tools and certifications like those offered by DataCamp can enhance SQL skills.

  4. 4
    Article
    Avatar of jobsJobs·38w

    🚨How one tiny SQL query nearly killed our production system 🚨

    A production outage caused by a seemingly innocent `SELECT *` query demonstrates how database queries that work fine in development can fail catastrophically at scale. The query pulled 720MB of data from 60,000+ records, causing memory pressure, network bottlenecks, and connection timeouts. The post provides practical solutions including selecting specific columns, implementing pagination, caching hot data, using EXPLAIN plans, monitoring slow queries, and testing with production-scale data.

  5. 5
    Article
    Avatar of gcgitconnected·31w

    How to Scale Like a Senior Engineer (Servers, DBs, LBs, SPOFs)

    Scaling systems is about solving problems incrementally, not jumping to complex solutions. Start with understanding single server limitations, identify bottlenecks (CPU, memory, disk I/O), then make informed decisions about vertical vs horizontal scaling. Database optimization is often the real bottleneck, not application servers. Load balancers require careful algorithm selection and configuration. Even redundant architectures have single points of failure that need identification and mitigation. The key is adding complexity only when necessary and understanding the tradeoffs at each step.

  6. 6
    Article
    Avatar of medium_jsMedium·1y

    21 Essential System Design Building Blocks for Software Engineers

    System design is crucial for building scalable, efficient, and reliable systems. This post outlines 21 essential components such as CDN, databases, rate limiter, and API Gateway that form the foundation for robust system architecture. It emphasizes the importance of these building blocks in interviews and real-world applications like e-commerce platforms, and recommends resources for further learning.

  7. 7
    Article
    Avatar of strongdmstrongdm·46w

    PostgreSQL vs. MySQL: Differences for Tech Leaders & Teams

    PostgreSQL excels at complex, write-heavy workloads with advanced SQL features, rich data types like JSONB, and strict ACID compliance, making it ideal for financial systems and analytics. MySQL prioritizes speed and simplicity for read-heavy applications, offering lightweight architecture perfect for web apps, CMSs, and MVPs. PostgreSQL provides superior extensibility, query optimization, and enterprise features, while MySQL delivers faster performance for simple queries and lower resource consumption. The choice depends on workload complexity, data consistency requirements, and scalability needs.

  8. 8
    Article
    Avatar of vladmihalceaVlad Mihalcea·25w

    Just Use Postgres!

    A comprehensive review of Denis Magda's book covering PostgreSQL's capabilities beyond traditional relational features. The 402-page guide explores core database concepts like indexing (B+Tree, hash, partial), transactions, and modern SQL features (CTEs, window functions), then dives into non-relational capabilities including JSON storage and full-text search. The book examines PostgreSQL's extension ecosystem: pgvector for ML/GenAI embeddings, TimescaleDB for time series data, PostGIS for geospatial queries, and pgmq for message queues. Includes performance tuning guidance and discusses when PostgreSQL might not be the right choice.

  9. 9
    Article
    Avatar of freecodecampfreeCodeCamp·40w

    How to Design Structured Database Systems Using SQL [Full Book]

    A comprehensive guide covering database fundamentals, from basic data concepts to designing structured database systems. Explores the DIKW pyramid (Data, Information, Knowledge, Wisdom), database management systems architecture, ACID properties, and various data models including relational databases, NoSQL systems, and Big Data approaches. Includes practical examples using PostgreSQL and covers essential topics like data types, domains, database design principles, and the differences between structured, semi-structured, and unstructured data.

  10. 10
    Article
    Avatar of techworld-with-milanTech World With Milan·48w

    What I learned from the book Designing Data-Intensive Applications

    A comprehensive review of Martin Kleppmann's "Designing Data-Intensive Applications" after two complete readings. The book provides foundational knowledge about distributed systems, covering reliability, scalability, and maintainability principles. Key topics include data models (relational vs document vs graph), storage engines (B-trees vs LSM-trees), replication strategies, partitioning, transactions, and stream processing. The review highlights the book's strengths in explaining trade-offs and connecting theory to practice, while noting limitations like outdated examples and dense theoretical content. Recommended for experienced engineers working with data-intensive systems.

  11. 11
    Article
    Avatar of hnHacker News·39w

    google/mangle

    Mangle is Google's open-source programming language that extends Datalog for deductive database programming. It enables querying data from multiple sources uniformly and supports recursive rules, aggregation, and function calls. The language is particularly useful for vulnerability detection, dependency analysis, and knowledge graph modeling. Implemented as a Go library, Mangle can be embedded into applications and offers practical extensions beyond traditional Datalog while maintaining accessibility for developers.

  12. 12
    Article
    Avatar of communityCommunity Picks·1y

    Bati

    A comprehensive guide to building a full-stack application with data fetching, authentication, database integration, and server setup.

  13. 13
    Article
    Avatar of bytebytegoByteByteGo·45w

    EP171: The Generative AI Tech Stack

    Comprehensive overview of the generative AI technology stack, covering nine key components from cloud infrastructure and foundational models to safety and monitoring tools. Also includes curated resources for learning software architecture, database indexing fundamentals, AI agent development roadmap, and an introduction to Model Context Protocol servers for connecting AI models to external tools and services.

  14. 14
    Video
    Avatar of asaprogrammerAs a Programmer·1y

    Next.js Tutorial 2025 - Build a Full Stack Social App with React & Next.js

    Learn to build a full stack social media application using React and Next.js. This detailed guide covers implementing core features like user authentication with Clerk, post creation, comments, likes, and notifications. The project also includes updating profiles, enabling dark mode, and ensuring a responsive UI design with Tailwind CSS. You will also integrate a PostgreSQL database using Prisma ORM and Neon, demonstrating key functionalities step-by-step.

  15. 15
    Article
    Avatar of francofernandoThe Polymathic Engineer·1y

    Database sharding case study: PostgreSQL

    Notion's engineering team faced significant challenges in scaling their monolithic PostgreSQL database due to rapid user base growth. They decided to implement database sharding, with the Block table and related tables being sharded using Workspace ID as the key. The migration involved a double-write phase and verification to ensure data integrity. Despite some lessons learned, such as the importance of starting early and aiming for zero downtime, the outcome was a more scalable and faster system for Notion's users.

  16. 16
    Article
    Avatar of hnHacker News·38w

    Marco – All your emails, one place

    Marco's engineering team shares their journey through the offline-first landscape, evaluating tools like WatermelonDB, Triplit, InstantDB, and PowerSync for building a cross-platform email client. They encountered significant performance issues with large datasets (100MB+) and ultimately settled on Replicache paired with Orama for indexing. The post highlights the fundamental challenges of implementing offline-first architectures in web browsers, where all solutions must work on top of IndexedDB's key-value storage limitations.

  17. 17
    Article
    Avatar of phProduct Hunt·26w

    Reindeer: Cursor for databases

    Reindeer is an AI-powered IDE for database work that understands database schemas and generates production-ready SQL queries. It features autocomplete for complex SQL, automatic query fixing, and schema-aware assistance to streamline debugging and query optimization workflows without switching between tools.

  18. 18
    Article
    Avatar of growwenggGroww Engineering·27w

    When Two Databases Become One: How DuckDB Saved Our Trading Operations from Manual Reconciliation

    A trading platform faced recurring position-order mismatches across two separate MySQL databases, requiring 20-30 minutes of manual reconciliation by two engineers. By leveraging DuckDB's MySQL scanner extension to perform cross-database joins, they automated the entire process into a 2-3 minute operation running every 15 minutes. The solution eliminated manual intervention, improved accuracy from 85% to 99.9%, and enabled proactive monitoring instead of reactive fixes during market hours.

  19. 19
    Article
    Avatar of architectureweeklyArchitecture Weekly·1y

    PostgreSQL JSONB - Powerful Storage for Semi-Structured Data

    PostgreSQL JSONB offers a powerful method for storing and querying semi-structured data. JSONB stores data in a binary format, allowing for efficient indexing and querying without the need for repeated parsing. The article discusses the internal structure of JSONB, performance benefits, and various indexing strategies like GIN and B-Tree to optimize JSONB queries. It also covers practical applications, such as using JSONB for managing heterogeneous data models and ensuring query performance. Although JSONB provides flexibility, it's essential to understand its performance implications for large datasets.

  20. 20
    Article
    Avatar of datadogDatadog·21w

    How microservice architectures have shaped the usage of database technologies

    Microservices have transformed database usage from monolithic, single-database architectures to distributed systems where organizations run multiple database technologies simultaneously. Analysis of 2.5 million services shows over half of organizations now use both SQL and NoSQL databases side by side, with many adopting 3+ different database technologies. This shift enables teams to choose the right tool for each service but introduces new challenges: fragmented schemas require data integration layers like GraphQL, analytics demands OLAP systems like Snowflake, and service communication relies heavily on message queues like Kafka and RabbitMQ for asynchronous decoupling.

  21. 21
    Article
    Avatar of hnHacker News·1y

    Database Relationship Diagrams Design Tool

    Dbdiagram offers a free tool for developers and analysts to design database relationship diagrams using simple DSL language. The platform supports features like ER diagram creation, web-based database documentation, and defining database schemas through code. Users can benefit from a streamlined development workflow for database design and analysis.

  22. 22
    Video
    Avatar of communityCommunity Picks·52w

    Multi-Tenant SaaS Architecture in 3 Simple Steps

    The post explains how to build a multi-tenant SaaS application in three steps. It starts by defining multi-tenancy, designing an entity relationship diagram, and finally, creating a multi-tenant application where organizations can manage blog articles. The architecture uses a single application instance and database for all tenants, differentiating data with a tenant-specific identifier. It includes the use of authentication and roles to manage user access and permissions across organizations.

  23. 23
    Article
    Avatar of communityCommunity Picks·49w

    Database Multi tenancy

    Multi-tenancy is an architecture where multiple independent application instances operate in a shared environment with logical isolation. The article explores four database multi-tenancy approaches: single database with shared schema (lowest cost, highest tenant density but minimal isolation), single database with separate schemas (better isolation, more complex maintenance), database per tenant (highest isolation, most resource intensive), and multiple databases with shared schemas (balanced approach). Each pattern has distinct trade-offs between cost, isolation, maintenance complexity, and scalability that should guide architectural decisions based on application requirements.

  24. 24
    Article
    Avatar of roadmaproadmap.sh·24w

    NEW ROADMAP: Elasticsearch

    A new learning roadmap for Elasticsearch has been released on roadmap.sh, providing a structured guide for developers working with search and database applications to learn and master Elasticsearch.

  25. 25
    Article
    Avatar of duckdbDuckDB·1y

    The DuckDB Local UI

    DuckDB, in collaboration with MotherDuck, has introduced a built-in local UI available starting from DuckDB v1.2.1. This UI can be launched via terminal or a SQL command and offers features such as interactive notebooks, a column explorer, and detailed table summaries. It runs all queries locally, ensuring data privacy unless explicitly connected to MotherDuck. The UI is designed to be simple, fast, feature-rich, and fully open source.