Best of Cloud — August 2024

1
Article
ByteByteGo·2y
EP123: What is a Load Balancer?
A load balancer distributes network or application traffic across multiple servers to ensure availability, reliability, and performance. There are different types of load balancers, including hardware, software, cloud-based, Layer 4, Layer 7, and Global Server Load Balancing. Load balancers improve scalability and help manage large-scale applications efficiently. The post also touches on various design patterns for Kubernetes and highlights a sponsored service by QA Wolf for improved QA cycles.
275
2
2
Article
Community Picks·2y
5 Docker Best Practices I Wish I Knew When I Started
Learn five key Docker best practices: use multi-stage builds for smaller images, utilize .dockerignore files to streamline builds, implement health checks to ensure container reliability, use Docker Compose for easier local development, and avoid the 'latest' tag for better version control. Additionally, perform regular security scans to maintain secure Docker environments.
254
21
3
Article
ByteByteGo·2y
EP126: The Ultimate Kafka 101 You Cannot Miss
This edition of the ByteByteGo newsletter covers several key topics, including a guide to understanding Apache Kafka, tips for efficient API design, an overview of AWS Services, and an advertisement for QA Wolf, an automated testing solution. Kafka is detailed with its core concepts like messages, topics, partitions, producers, consumers, clusters, and use cases. The AWS Services cheat sheet simplifies the exploration of AWS's expansive offerings. Additionally, the newsletter includes 8 practical tips for better API design.
193
4
Article
Hacker News·2y
Permify/permify: An open-source authorization as a service inspired by Google Zanzibar, designed to build and manage fine-grained and scalable authorization systems for any application.
Permify is an open-source authorization service inspired by Google Zanzibar, designed to implement fine-grained, scalable access controls quickly. It centralizes authorization logic, supports granular permissions, and offers fast response times for access checks. Start using it locally with a simple Docker command and contribute to its codebase, documentation, or playground for improvements.
168
2
5
Article
Community Picks·2y
We documented 50 common DevOps and SecOps tasks – Here’s what we learned.
After documenting 50 common DevOps and SecOps tasks, key takeaways include the importance of effective querying across cloud resources, the impacts of numerous cloud configuration options, the critical role of security in cloud operations, and the manual nature of mitigating automated vendor billing. Blink offers a no-code/low-code platform to help streamline these tasks and create impactful automations efficiently.
136
1
6
Article
Project IDX·2y
IDX
Project IDX now supports Gitlab and Bitbucket repositories, available in an early preview for all users. Watch the video for walkthroughs and detailed information.
130
8
7
Video
YouTube·2y
Complete Kubernetes Course - From BEGINNER to PRO
This complete Kubernetes course, designed by Sid from DevOps Directive, is intended for software engineers seeking to enhance their DevOps and infrastructure skills by mastering Kubernetes. The course covers both theoretical and practical aspects, including deploying demo applications across multiple environments. The course provides code samples in a companion GitHub repository and offers interactive modules via a platform and a Discord community. Key prerequisites include familiarity with web applications, basic shell commands, cloud infrastructure knowledge, and intermediate containerization skills. The course broadly covers setting up development environments, clustering, resource types, Helm, debugging applications within Kubernetes, and automation techniques.
118
2
8
Video
Be A Better Dev·2y
Learn Docker & Deploy to AWS - Beginner Tutorial
117
9
Article
Laravel News·2y
Introducing Laravel Cloud
Taylor unveiled Laravel Cloud at Laracon 2024 as a new app platform for deploying Laravel apps instantly. Highlights include auto-scaling, DDoS protection, push-to-deploy, and on-demand database scaling with Serverless Postgres. It aims to eliminate DevOps complexities, allowing developers to focus on shipping their ideas quickly. Interested users can join the waiting list for early access.
112
6
10
Article
ByteByteGo·2y
How Facebook Syncs Time Across Millions of Servers
Facebook faced significant challenges in maintaining precise time synchronization across millions of servers due to inaccuracies in internal clock oscillators. Initially, they used Network Time Protocol (NTP) and later switched to Precision Time Protocol (PTP) to achieve nanosecond-level precision. The transition was driven by the need for higher accuracy to support advanced systems and applications like the metaverse. PTP uses hardware timestamping and transparent clocks to mitigate latency and improve synchronization. This implementation enhances various operations, including logging, coordination, and handling user requests in a distributed system.
101
1
11
Video
YouTube·2y
Where is Rust being used?
Rust is increasingly being adopted across various industries due to its performance, memory safety, and robust type system. Key industries embracing Rust are cloud infrastructure (with companies like AWS, Google, and Microsoft using it for critical projects), web3 (platforms like Solana and Polkadot), systems and low-level programming (such as parts of Firefox and Windows), cybersecurity, and finance. Emerging areas of adoption include aerospace, robotics, and gaming. Knowing Rust fundamentals, building real-world projects, and networking are crucial for landing Rust roles.
97
4
12
Article
Community Picks·2y
Next.js authentication using Clerk, Drizzle ORM, and Neon
Learn to build a Next.js application with Clerk for authentication and Neon’s Serverless Postgres using Drizzle ORM. The post guides you through setting up user management, database schema, migrations, and adding interactivity. Deploy a full-featured app with secure authentication and efficient data storage.
93
13
Article
Hacker News·2y
Tracking supermarket prices with playwright
In Dec 2022, a website was created to track price changes in Greece's largest supermarkets using Playwright for web scraping. The main challenges included handling JavaScript-based sites, automating the scraping process, and avoiding IP restrictions. After initial attempts with an old laptop failed, a decision was made to use Hetzner for its cost-efficiency. The setup integrated Tailscale to tackle IP restrictions and used a CI server to manage daily scraping tasks. Optimizations focused on improving scrape speed and cost-efficiency, like upgrading server specs and reducing data fetched.
89
2
14
Article
Community Picks·2y
PostgreSQL databases under attack
Poorly protected PostgreSQL databases on Linux are being targeted by cryptojacking attackers. Aqua Security researchers observed attackers brute-forcing access credentials, creating new high-privilege user roles, removing superuser privileges from compromised roles, and downloading payloads that eliminate competing cryptomining malware. PostgreSQL databases, often found in cloud and on-premises environments, are frequent targets due to lax security or misconfigurations. To protect these databases, using firewalls, VPNs, SSH tunnels, strong passwords, audit logs, and intrusion detection systems is advised.
86
2
15
Article
Tinybird·2y
Tinybird vs. ClickHouse
ClickHouse is an open-source columnar database ideal for real-time analytics, while Tinybird is a data platform built on ClickHouse that simplifies management and speeds up deployment. Tinybird offers out-of-the-box tuning, API generation, and native connectors, reducing the need for deep expertise and infrastructure management. ClickHouse allows for more granular control and tuning, appealing to those willing to manage their own infrastructure. Both provide robust performance, but Tinybird is designed to minimize setup efforts and accelerate time to production.
77
1
16
Article
Quastor Daily·2y
How Canva Collects 25 Billion Events Per Day
Canva processes over 25 billion events daily using AWS Kinesis, benefiting from its real-time data analysis and cost-saving features. Their data pipeline involves event batching, compression, and enrichment before routing to Snowflake for further analysis. The switch from AWS SQS to Kinesis significantly reduced their costs by 85%.
73
1
17
Article
strongdm·2y
Kubectl Cheat Sheet - Kubernetes Commands (Basic to Advanced)
Kubernetes is a widely used container-centric management system created by Google and maintained globally. The kubectl command-line tool allows users to manage clusters, configure deployments, and perform various administrative tasks. This comprehensive cheat sheet covers installing kubectl, verifying installations, managing contexts for multiple clusters, core kubectl commands, and advanced operations such as monitoring, debugging, and securing access. Tips for increasing efficiency with kubectl, like customizing outputs and setting aliases, are also included.
70
18
Article
Community Picks·2y
10 Things You Can Learn from Netflix’s Architecture
Netflix's architecture, supporting 247 million subscribers, employs a client-backend-CDN system structure to ensure efficient streaming and exceptional user experience. Leveraging AWS for backend scalability, Netflix uses 700 microservices for modularity and ease of maintenance, and implements geographical redundancy for reliability. Through its custom CDN, Open Connect Appliance (OCA), and intelligent content delivery mechanisms, Netflix enhances streaming quality and performance. Additional strategies like efficient transcoding, predictive caching, DRM, and adaptive network handling further ensure a seamless experience across diverse devices and network conditions.
69
5
19
Video
YouTube·2y
C# (.NET) vs. Go (Golang): Performance Benchmark in Kubernetes
A performance benchmark comparison between C# (.NET 8) and Golang in a Kubernetes environment, testing CPU usage, memory usage, request handling, and end-user latency. The tests include a minimal API test and a typical use case with file upload to S3 and metadata storage in a Postgres database. Golang generally performs better, with lower CPU and memory usage, while C# shows higher latency. The post includes detailed metrics and setups for monitoring using Prometheus, Grafana, and cAdvisor.
56
2
20
Article
Software Testing Magazine·2y
Who Is a DevOps Engineer, and What Does This Role Involve?
DevOps engineers bridge the gap between development and operations, ensuring faster and more reliable software releases. They focus on automating infrastructure provisioning, collaborating with development teams, and improving system reliability and uptime. They require a diverse set of skills, from cloud platforms to CI/CD pipelines. The role emphasizes cultural transformation and collaboration to deliver better software and achieve organizational success.
55
2
21
Article
DEV·2y
Introducing AutoMQ: a cloud-native replacement of Apache Kafka
AutoMQ is a cloud-native replacement for Apache Kafka, designed to address the evolving needs of modern data architectures with a focus on efficiency, scalability, and cost-effectiveness. Originating from a team of open-source pioneers, it offers a unique architecture that decouples storage and computation, leveraging cloud storage to provide significant cost savings and operational efficiency. AutoMQ maintains full compatibility with Kafka, supports multi-cloud environments, and aims to integrate stream data into data lakes to enhance data access and break down silos. The growing community and successful funding highlight its potential impact on the stream storage industry.
55
2
22
Article
KDnuggets·2y
Tools Every AI Engineer Should Know: A Practical Guide
Being an AI engineer requires expertise in various tools and skills such as Python, R, big data frameworks like Hadoop and Spark, and cloud services like AWS, GCP, and Microsoft Azure. These tools are essential for building and optimizing AI systems. An AI engineer must also have solid programming knowledge, a deep understanding of machine learning, and practical experience through data projects, competitions, and open-source contributions.
54
1
23
Article
Faun·2y
Nitric is Terraform for Developers
Nitric introduces a new paradigm called Infrastructure from Code (IfC), designed to bring the clarity and execution capabilities of Infrastructure as Code (IaC) tools like Terraform to application developers. With Nitric, you can document application requirements in a clear, concise, and executable format using Nitric SDKs and CLI, enabling easier and more efficient development and cloud infrastructure management.
54
11
24
Article
elastic·2y
Elasticsearch is open source, again
Elasticsearch and Kibana are now open source again with the addition of the AGPL license option. Elastic believes this move will reduce confusion and strengthen their open-source commitment. The decision comes three years after changing the license due to issues with AWS, which ultimately resolved market confusion and bolstered the AWS partnership. Existing licenses (ELv2 and SSPL) remain in place, providing more choices for users.
53
2
25
Article
Community Picks·2y
The smallest PaaS implementation you've ever seen
Dokku provides an open-source PaaS alternative to Heroku, facilitating application lifecycle management from building to scaling. The latest release (v0.34.9) includes quick-start instructions for installation and configuration. Dokku can be set up using a simple installation script and commands to configure the server domain and SSH key. It also offers official setup guides for Azure, DigitalOcean, and DreamHost Cloud.
49
3

See all Cloud archives