The React Community·2yFree for Developers 🔥
Developers have access to many free tier services across SaaS, PaaS, and IaaS, but finding comprehensive lists can be time-consuming. This curated list includes services particularly useful for infrastructure developers and is continuously updated by community contributions. Note: self-hosted software is excluded, and to be eligible, a service must offer a free tier for at least a year.
Community Picks·2yWhat Is Sidekick
Sidekick simplifies the deployment of applications by allowing users to host multiple apps on a single VPS and make them production-ready easily. With features like one-command VPS setup, zero downtime deployment, high availability, and built-in SSL certification, it aims to be an affordable and straightforward solution for side projects.
Community Picks·2y9 Open Source Projects Every Developer Needs to Bookmark 📚👨💻
Discover 9 powerful open-source projects to enhance your workflow, whether you're a beginner or experienced developer. These tools span cloud management, feature flagging, user feedback, URL shortening, project management, data collaboration, LLM workflow building, privacy-focused AI, and documentation site generation. Each tool comes with detailed features and GitHub repositories for easy access.
Tech World With Milan·2yWhat is CI/CD Pipeline ?
Delivering quality software swiftly is essential in modern development. Continuous Integration and Continuous Delivery (CI/CD) pipelines help teams integrate code frequently and deploy it automatically, preventing integration issues and ensuring a reliable release cycle. Key stages in a CI/CD pipeline include source, build, test, and deploy. Popular CI/CD tools include GitHub Actions, Jenkins, TeamCity, CircleCI, and Azure DevOps. Optimizing your CI/CD pipeline involves identifying bottlenecks, streamlining builds, improving test efficiency, and leveraging caching. Choosing the right CI/CD platform depends on factors such as cloud-based versus self-hosted options, user-friendliness, and integration capabilities.
ByteByteGo·2yEP136: The Ultimate DevOps Developer Roadmap
The Ultimate DevOps Developer Roadmap highlights key areas for mastering DevOps skills, including programming languages like Python and JavaScript, operating systems, source control management tools, networking basics, CI/CD tools, scripting, various hosting platforms, infrastructure as code tools, and monitoring/logging tools. Each aspect is crucial for a well-rounded DevOps professional. Additional content covers Redis fundamentals, various software architectural patterns, and eventual consistency patterns for distributed databases.
Community Picks·2yDocker Image Optimization: Reducing Size for Faster Deployments
Learn how to significantly reduce Docker image sizes to improve deployment times, save storage costs, and enhance your CI/CD pipeline's efficiency. The post covers effective strategies such as choosing minimal base images, using multi-stage builds, removing unnecessary files, combining layers, and using tools like `docker-slim`. Regular auditing and pruning of images also ensure a lean and efficient Docker environment.
Hacker News·1yComputer Networking Fundamentals
This post provides a succinct and illustrated guide to computer networking basics, focusing on practical knowledge for developers. It covers fundamental concepts like the Data link layer, iptables in Linux, SSH tunnels, and the differences between network bridges and switches. Additionally, the post includes various hands-on labs to help readers understand and apply the concepts in real-world settings.
Community Picks·2y7+ Free PostgreSQL Hosting Platforms for Developers in 2024
Several cloud providers offer free tiers for PostgreSQL hosting, ideal for developers working on small projects, personal experiments, or startup MVPs. Notable platforms include Neon, Supabase, EdgeDB, Xata, Tembo, Vercel Postgres, Koyeb, Aiven, and Nhost. These options provide scalable, fully managed databases with features like autoscaling, database branching, and integrated authentication, allowing developers to focus on development without worrying about infrastructure costs.
DEV·2yDiagram-as-Code: Creating Dynamic and Interactive Documentation for Visual Content
Learn how to leverage Diagram-as-Code to create dynamic and interactive visual documentation using Python. This approach allows you to programmatically generate and maintain diagrams, making them always up-to-date. The post introduces the Diagrams Python library, details its benefits, and provides step-by-step tutorials on installation, node types, and creating diagrams for different cloud providers such as AWS.
Spacelift·2yK3s vs K8s: Differences, Use Cases & Alternatives
K3s is a lightweight, production-ready Kubernetes distribution tailored for resource-constrained environments such as IoT, edge computing, and local development. It simplifies deployment through a single binary, uses less memory and CPU, and includes default tools like containerd and Traefik. While K3s is easier to set up and maintain compared to standard Kubernetes (K8s), it may lack some advanced features and security options. Managed cloud services like Amazon EKS and Google GKE offer alternative options for more complex, large-scale environments.
Quastor Daily·2yThe Architecture of Dropbox's Load Balancing Service
Dropbox reduced the sizes of its hardware fleets by 25% and saved millions annually by deploying the Robinhood load balancing service in 2020, improving load distribution among backend machines. Key components of Robinhood include a service discovery system, a routing database, and a proxy for aggregating load reports. Dropbox evaluates load balancer performance using CPU utilization ratios such as max/avg and p95/avg. They emphasized simplicity in configuration, minimizing client changes, and early migration planning as crucial lessons learned.
theburningmonk.com·2yWhen to use Light Events vs. Rich Events in Event-Driven Architectures
Choosing between light and rich events in event-driven architectures involves trade-offs. Light events, containing minimal information, are cost-efficient but may increase complexity for subscribers needing additional data. Rich events include more information, reducing the need for extra calls by subscribers but increasing data transfer and storage costs. Domain events, often benefitting from light events, are shared within the same domain, while integration events, suited for rich events, are shared across domains. Understanding these differences helps optimize event design and system efficiency.
ByteByteGo·2yHow McDonald Sells Millions of Burgers Per Day With Event-Driven Architecture
McDonald's has developed a unified, event-driven platform to handle its global operations efficiently. The platform supports scalability, high availability, performance, security, reliability, consistency, and simplicity. Core components include AWS Managed Streaming for Kafka (MSK), a schema registry, a standby event store, custom SDKs, and an event gateway. The system ensures data integrity and efficient processing through schema validation and robust error-handling mechanisms. Key techniques include data governance, cluster autoscaling, and domain-based sharding. Future enhancements include formal event specification, transition to serverless MSK, and improved developer tooling.
Community Picks·1yTop 10 Must-Listen Software Developer Podcasts in 2024
Staying updated with industry trends is crucial for both veteran and junior programmers. One effective way to achieve this is through podcasts. This curated list includes top software developer podcasts such as Software Engineering Daily, Talk Python to Me, Dev Interrupted, The Cloudcast, The Changelog, Thoughtworks Technology, The CSS Podcast, Neil on Software, In Machines We Trust, and Software Engineering Radio. These podcasts cover a wide range of topics from Python, cloud computing, and open source to AI and latest tech trends, providing valuable insights and knowledge to enhance your skills and career.
Be A Better Dev·1yI Wish I Knew This One Thing Before Learning AWS
Understanding the core services in AWS, such as EC2, S3, SQS, SNS, and DynamoDB, is essential before diving into other services. These foundational services form the basis upon which other, more advanced services are built. Having a strong understanding of these basics will facilitate learning and using more complex AWS offerings.
Community Picks·2yGoogle Open Source
Google leverages open source to fuel innovation and share their advancements. Explore their featured projects like Android, Kubernetes, TensorFlow, and many more. Each project supports various technologies and aims to enhance user experience, streamline developer workflows, or manage complex systems. From operating systems and development tools to data processing and machine learning platforms, Google’s open source projects cater to diverse needs.
freeCodeCamp·2yWhat is Cloud Computing? A Guide for Beginners
Cloud computing involves using the internet to access storage, databases, and computing power on powerful remote servers, eliminating the need for businesses to have large physical servers. Major cloud providers such as AWS, Microsoft Azure, and Google Cloud offer scalable, flexible, and reliable services. Cloud computing includes services like IaaS, PaaS, and SaaS, each offering different levels of control. Its benefits include cost reduction, enhanced collaboration, and reliable backups, making it crucial for modern businesses and individuals.
Quastor Daily·2yHow Reddit built a Metadata Store that Handles 100k Reads per Second
Reddit developed a media metadata store that handles 100k reads per second to accommodate their rapidly growing user base. They opted for Sharded Postgres over Cassandra due to easier management and fewer denormalization issues. The migration involved dual writes, backfill data, and dual reads. Their scaling strategies include table partitioning using the pg_partman extension and data denormalization to optimize query efficiency.
Fireship·2ySQLite and its weird new fork “libSQL”
SQLite, originally created for the US Navy, is a widely deployed, serverless SQL database. Its open-source nature has led to the fork named libSQL, which adds server mode and enhanced features like replication, encryption, and WebAssembly triggers. These improvements support unique databases per user, offering better performance and scalability, particularly in serverless environments.
Community Picks·2ykestra-io/kestra: :zap: Workflow Automation Platform. Orchestrate & Schedule code in any language, run anywhere, 500+ plugins. Alternative to Zapier, Rundeck, Camunda, Airflow...
Kestra is an open-source, event-driven orchestration platform that simplifies the creation of scheduled and event-driven workflows. Its key features include a declarative YAML interface, robust plugin ecosystem, intuitive UI, and compatibility with Git version control. It supports running tasks in various languages and environments, such as Docker and Kubernetes, and integrates seamlessly with cloud services like AWS, Google Cloud, and Azure. Kestra's scalable infrastructure is designed for high availability and can handle millions of workflows, enabling powerful automation and data processing capabilities.
Container Journal·1yTop 10 Kubernetes Tools
Kubernetes offers a wide range of tools that simplify the deployment, scaling, and management of container-based applications. Key tools include Kubectl for command-line management, Helm for package management, k9s for terminal-based cluster management, Kustomize for customizing configurations, Grafana for monitoring, Istio for microservices management, Jaeger for tracing transactions, Prometheus for monitoring and alerting, Minikube for local development, and Lens as an IDE. Each tool serves a specific need, enhancing the efficiency and effectiveness of Kubernetes operations.
Community Picks·2ycshum/imagor: Fast, secure image processing server and Go library, using libvips
imagor is a robust image processing server and Go library that utilizes the efficient libvips library, providing 4-8x faster performance than ImageMagick. It supports various image processing use cases through a HTTP server, integrates seamlessly with Docker, and offers video thumbnail capabilities via ffmpeg bindings. imagor can be configured for different storage solutions like HTTP, file system, AWS S3, and Google Cloud Storage, supporting complex image operations and filters with secure URL signing to prevent DDoS attacks.
Medium·1yTuning Go Application, which has GC issues with a few steps
Working on a project involving Kafka and Google Cloud Storage, the author faced significant GC issues with their Go application compared to the Confluent Google Cloud Sink Connector. By employing techniques like using sync.Pool, preallocating slices, switching to the bytedance/sonic JSON library, and tuning GOGC and GOMEMLIMIT settings, they improved performance, reducing GC pause frequency and time, while increasing CPU utilization and memory usage for better overall efficiency.
The Polymathic Engineer·2yThe fallacies of distributed systems
This post discusses the eight commonly overlooked fallacies of distributed systems identified by Peter Deutsch and others at Sun Microsystems. These fallacies include the reliability of networks, latency, bandwidth limitations, network security, dynamic network topology, multiple administrators, transport costs, and network heterogeneity. Understanding and mitigating these assumptions are crucial in designing robust distributed systems. Several strategies such as retransmission mechanisms, caching, data compression, and security measures are recommended to tackle these issues.
Data Engineer Things·1yI spent 4 hours learning how Netflix operates Apache Iceberg at scale.
Netflix has developed a sophisticated data platform to handle extensive data pipelines and analytics, using Apache Iceberg to overcome the limitations of their previous Hive-based system. Key components include Polaris, a custom metastore for Iceberg, and Janitors, a cleanup service. They also implemented Autotune for optimizing data layout and Autolift for localizing data files. Moreover, secure access controls were established for Iceberg tables. Netflix's migration tool for transitioning from Hive to Iceberg minimizes data movement and business interruptions.