Best of Backend Development — November 2024

  1. 1
    Article
    Avatar of communityCommunity Picks·1y

    10 Data Structures That Make Databases Fast and Scalable

    Modern databases achieve high speed and efficiency through the use of advanced data structures and indexing techniques. This includes hash indexes for fast insertion and lookup, B-Trees for optimized reads and writes, skip lists for fast operations on dynamic datasets, memtables for efficient writes, and SSTables for optimized storage of key-value pairs. Additional structures like inverted indexes, Bloom filters, bitmap indexes, R-trees, and Write-Ahead Logs further enhance performance and reliability by improving search capabilities, reducing memory usage, speeding up complex queries, and ensuring data consistency even during crashes.

  2. 2
    Video
    Avatar of youtubeYouTube·1y

    Learn Backend Development in 4 Hours | Backend Web Development Full Course

    The post provides a comprehensive guide to backend web development using Node.js and Express.js, starting from installation and setup to creating servers and handling routes. It explains the use of middleware and package management with npm. The guide includes practical examples and code snippets to help beginners understand and implement backend services effectively.

  3. 3
    Video
    Avatar of bytebytegoByteByteGo·1y

    API Pagination: Making Billions of Products Scrolling Possible

    API pagination is crucial for handling large data sets by splitting results into smaller chunks, which improves server load, reduces network traffic, and keeps applications responsive. There are two main pagination methods: offset-based and cursor-based. Offset-based pagination is easy to implement but can be slow and inconsistent with large or fast-changing datasets. Cursor-based pagination, though more complex, offers greater consistency and performance by using index columns or timestamps as cursors, making it ideal for real-time data.

  4. 4
    Article
    Avatar of collectionsCollections·1y

    Master Event-Driven Architecture by Building a SaaS Application with Next.js, Clerk, and NeonDB

    Learn to build scalable SaaS applications using Next.js, Clerk, and NeonDB with a focus on event-driven architecture. This course covers essential topics such as SaaS starter templates, database management with NeonDB, custom authentication and role-based access control using Clerk, handling webhooks, and integrating APIs. Gain practical experience through hands-on exercises to apply your knowledge in real-world projects.

  5. 5
    Article
    Avatar of newstackThe New Stack·1y

    Elasticsearch Was Great, But Vector Databases Are the Future

    Keyword matching, represented by Elasticsearch, has been the standard for information retrieval systems. However, as AI-powered semantic search technology advances, vector databases are becoming central to a new era of search. Combining both approaches, hybrid search uses a mix of vector and traditional search methods, balancing semantic relevance with exact keyword matching. Milvus is highlighted as a vector database offering efficiencies and performance improvements over Elasticsearch, particularly in handling dense and sparse vectors. This unified approach simplifies infrastructure and enhances search capabilities, making vector databases a promising solution for future advanced search needs.

  6. 6
    Article
    Avatar of rubyflowRuby Flow·1y

    renuo/hotsheet: Manage your database with a simple and familiar web interface

    This gem, Hotsheet, allows you to manage your database through a simple web interface without needing to use the Rails console. It offers inline editing for database records and provides controlled access to admin users. Installation involves adding it to your Gemfile and configuring it in an initializer file to specify which models and attributes to manage.

  7. 7
    Article
    Avatar of communityCommunity Picks·1y

    25 Reasons Why Financial Enterprise Companies Use Java

    Financial enterprise companies heavily rely on Java due to its maturity, stability, and broad adoption. The Java Virtual Machine (JVM) is lauded for its robust engineering, making Java ideal for large-scale, mission-critical systems, especially in fintech where accuracy and reliability are essential. Java's strong, static typing, extensive standard libraries, and a large pool of experienced developers further cement its dominance in the financial sector.

  8. 8
    Article
    Avatar of cratedbCrateDB·1y

    Real-Time Data Indexing: Index Everything, Query Anything, Real-time

    Relational databases have evolved significantly since their inception between 1976 and 1979, notably with the introduction of query optimization using indexes. The 2010s saw the rise of schemaless databases, allowing developers to manage data without predefined schemas. CrateDB enhances this concept by indexing every column by default using Lucene, providing high query efficiency but with increased storage requirements. This revolutionary approach simplifies and accelerates database management, potentially rendering traditional database optimization roles obsolete.

  9. 9
    Article
    Avatar of quastorQuastor Daily·1y

    How Reddit built a Metadata Store that Handles 100k Reads per Second

    Reddit developed a media metadata store that handles 100k reads per second to accommodate their rapidly growing user base. They opted for Sharded Postgres over Cassandra due to easier management and fewer denormalization issues. The migration involved dual writes, backfill data, and dual reads. Their scaling strategies include table partitioning using the pg_partman extension and data denormalization to optimize query efficiency.

  10. 10
    Article
    Avatar of semaphoreSemaphore·1y

    How Attackers Use HTTP Status Codes for Malicious Purposes

    HTTP status codes are crucial for communication between servers and clients, but they can be exploited by attackers to compromise servers. Understanding the role of status codes, how attackers use them, and proper handling techniques are essential for web application security. While returning uncommon status codes might confuse attackers temporarily, following API security best practices is the real solution to mitigate risks.

  11. 11
    Video
    Avatar of fireshipFireship·1y

    SQLite and its weird new fork “libSQL”

    SQLite, originally created for the US Navy, is a widely deployed, serverless SQL database. Its open-source nature has led to the fork named libSQL, which adds server mode and enhanced features like replication, encryption, and WebAssembly triggers. These improvements support unique databases per user, offering better performance and scalability, particularly in serverless environments.

  12. 12
    Article
    Avatar of communityCommunity Picks·1y

    FlareSolverr/FlareSolverr: Proxy server to bypass Cloudflare protection

    FlareSolverr is a proxy server designed to bypass Cloudflare and DDoS-GUARD protection using Selenium with an undetected Chrome driver. It opens URLs with user parameters, solves Cloudflare challenges, and returns HTML code and cookies. Installation using Docker is recommended due to its dependencies on an external browser. Memory consumption can be high, so it should be used cautiously on low-RAM machines. It supports multiple architectures and provides examples for making requests via Bash, Python, and PowerShell. Users can also create permanent sessions to avoid repeatedly solving challenges.

  13. 13
    Video
    Avatar of codeheimcodeHeim·1y

    #65 Golang - Build REST APIs with Golang and MongoDB

    Learn how to build REST APIs using Golang and MongoDB. The guide covers setting up the MongoDB Go driver, structuring the project using MVC, connecting to the database, and implementing CRUD operations for movie records. The tutorial includes examples of inserting, updating, deleting, and querying data in MongoDB.

  14. 14
    Video
    Avatar of communityCommunity Picks·1y

    Everything You NEED to KNOW About Web Applications

    Explore the key components of a production web application, including CI/CD pipelines, load balancers, reverse proxies, content delivery networks (CDNs), databases, caching, job workers, search services, and monitoring tools. Learn how these elements ensure scalability, reliability, and efficient performance.

  15. 15
    Article
    Avatar of devsquadDev Squad·1y

    🔥 Hono + ⚡️ Supabase Boilerplate

    This project is a backend boilerplate utilizing the Hono framework, hosted on Cloudflare Workers. It integrates Supabase for user authentication and authorization.

  16. 16
    Article
    Avatar of devsquadDev Squad·1y

    🚀 Automate Your PostgreSQL Backups with Ease! 🐳

    Simplify database management with a robust system for backup and restore using Deno, Docker, and Cloudflare R2. Features include automated backups via cron or on-demand, seamless restores from local files or R2, and easy cloud integration. To get started, clone the appropriate repo, configure your environment file, and run the specified Deno tasks.

  17. 17
    Article
    Avatar of jetbrainsJetBrains·1y

    Deploying Go Apps with Kubernetes

    The post provides a comprehensive tutorial on deploying Go applications with Kubernetes. It covers the steps to create a basic Go application, containerize it using Docker, and deploy it to a local Kubernetes cluster using Docker Desktop. The tutorial includes code snippets for setting up the database with GORM, building core business functions, creating and configuring Dockerfiles, writing Kubernetes manifests, and deploying both the database and application. It also offers guidance on interacting with Kubernetes clusters directly from GoLand IDE.

  18. 18
    Article
    Avatar of itnextITNEXT·1y

    Yes, here’s the best way to build a SaaS or micro-SaaS

    The post outlines the best approaches and tech stack for building a SaaS or micro-SaaS, emphasizing the importance of defining the problem, target, and marketing strategy before diving into tech choices. It suggests using a CMS like WordPress for marketing websites, using frameworks like Laravel, Django, or Ruby on Rails for backend-heavy projects, and leveraging BaaS options like Supabase for both backend-heavy and frontend-heavy projects. Recommendations also include using tools like Stripe for payment processing and various analytics tools to track user behavior.

  19. 19
    Article
    Avatar of springSpring·1y

    Bootiful Spring Boot 3.4: Spring Batch

    Spring Batch 5.2 introduces various new features to enhance batch processing. Notable additions include multiple job repository implementations, such as a MongoDB-backed JobRepository and a resource-less JobRepository. The release improves support for Spring Data JPA and item readers/writers, including new Kotlin data class support and concurrent steps using blocking queues. The new features like CompositeItemReader and BlockingQueueItemWriter promise more robust and scalable batch processing by leveraging staged event-driven architecture and virtual threads in Java 21.

  20. 20
    Video
    Avatar of codeheimcodeHeim·1y

    #64 Golang - Multipart Upload Using net/http

    Learn how to handle large file uploads in Golang using multipart uploads with the net/http package. This guide covers implementing a server for multipart uploads, setting file size limits, and creating a simple client to test the functionality. By using multipart uploads, developers can efficiently manage large files, include metadata, and handle retries for individual file parts.

  21. 21
    Article
    Avatar of lobstersLobsters·1y

    What I Wish Someone Told Me About Postgres

    Learn about essential tips and practices for working with Postgres that aren't always clear from the documentation. Covers topics like data normalization, useful psql shortcuts, handling NULLs, the importance of indexing, and managing locks. Also addresses the use of JSONB for flexible data storage and the potential pitfalls of long-running transactions.

  22. 22
    Article
    Avatar of communityCommunity Picks·1y

    How Databases Keep Passwords Securely 🔒

    Learn how databases securely store passwords using techniques such as hashing, salting, and stretching. Hashing transforms passwords into unique fingerprints, making them difficult to retrieve in plaintext. Salting adds a unique random string to each password to thwart rainbow table attacks, while stretching applies the hash function multiple times to slow down brute force attacks.

  23. 23
    Article
    Avatar of fluttersquadFlutter Developers·1y

    Building a Full Stack Flutter Application in Dart

    Learn how to build a full stack Flutter application using Dart for both the API and Storage backend. The guide provides comprehensive instructions to create a seamless integration between Flutter and Dart.

  24. 24
    Article
    Avatar of frankelA Java geek·1y

    DuckDB in Action

    DuckDB in Action by Mark Needham, Michael Hunger, and Michael Simons offers a detailed guide to DuckDB with a step-by-step approach. The book covers DuckDB basics, advanced SQL queries, and its integration with ecosystems like Python’s Pandas and Apache Spark. Despite being informative, the book struggles with focus, fluctuating between teaching DuckDB and general SQL learning.

  25. 25
    Article
    Avatar of eatonphilPhil Eaton·1y

    1 million page views

    The author celebrates passing 1 million page views on their blog. They started blogging in 2018, focusing initially on JavaScript and Scheme before transitioning to topics like bytecode VMs, emulators, databases, and distributed systems. Their motivation stems from a desire to provide complete, minimal implementations to help others avoid the confusion of incomplete resources. They also find value in writing survey posts and emphasize the importance of continuous learning and healthy obsessions outside of writing.

See all Backend Development archives