Best of AWS — December 2024

  1. 1
    Article
    Avatar of devtoDEV·1y

    Cracking AWS Certifications: A Guide From Beginner to Pro

    2024 has been a year filled with successful completion of AWS certifications. Key insights include the importance of understanding personal learning styles, hands-on experience, and practical application of knowledge. Each certification from AWS Certified Cloud Practitioner to AWS Certified Developer - Associate offers unique challenges and areas of focus, from general cloud knowledge to specific roles like security, DevOps, and machine learning. Planning the sequence of exams and understanding fundamental AWS concepts are critical for success. The journey emphasizes growth through continuous learning and effective preparation.

  2. 2
    Article
    Avatar of awsfundamentalsAWS Fundamentals·1y

    Building a Social Stats Dashboard with SST & Next.js

    Learn how to build a Social Stats Dashboard for tracking AWS Fundamentals Newsletter subscribers using AWS Lambda, Serverless Stack (SST), and Next.js. This guide is tailored for AWS beginners and walks through setting up the infrastructure, fetching data from third-party APIs, and displaying it on a user interface using serverless components and functions.

  3. 3
    Article
    Avatar of communityCommunity Picks·1y

    cloudlena/s3manager: A Web GUI for your S3 buckets

    s3manager is a Web GUI written in Go for managing S3 buckets from any provider. It allows users to list buckets, create new ones, upload and download objects, and delete objects. The application is configurable via environment variables and can be run locally, with Docker, or deployed to a Kubernetes cluster. It supports SSL, various signature types, IAM roles, and server-side encryption.

  4. 4
    Article
    Avatar of gcgitconnected·1y

    PostgreSQL Shared Buffer, What Backend Developers Should Know

    For backend developers, understanding and configuring PostgreSQL shared_buffers is critical. Shared buffers are a key part of PostgreSQL's architecture, acting as an intermediary between the database and the disk rather than a simple cache. Proper configuration typically involves allocating around 25% of RAM to shared_buffers and monitoring their performance using tools like pgbuffercache and pginspect. Optimizing shared_buffers can significantly enhance read and write operations, reducing the need for frequent disk access.

  5. 5
    Article
    Avatar of hnHacker News·1y

    anvaka/map-of-github: Inspirational Mapping

    This project maps over 400,000 GitHub projects, clustering them based on common stargazers. Using data from GitHub's public activity events, Jaccard Similarity, and AWS for processing, the map visualizes connections between repositories. The layout was computed with ngraph.forcelayout and rendered with maplibre. Clusters and labels were generated with the help of various tools, including ChatGPT. The project is open-source under the MIT license, with contributions welcome.

  6. 6
    Article
    Avatar of lobstersLobsters·1y

    Building a distributed log using S3 (under 150 lines of Go)

    The post describes how to implement a durable, distributed, and highly available log using AWS S3 in less than 150 lines of Go. Key highlights include the structure of the log interface, the implementation of the Append and Read operations, handling concurrent writes with S3 conditional writes, and failover/crash recovery mechanisms. The open-source project includes code and tests, with several open issues for further improvements.

  7. 7
    Article
    Avatar of medium_jsMedium·1y

    AWS S3 Deep Dive

    Amazon S3 (Simple Storage Service) is a scalable object storage service offering high availability, security, and performance for various use cases like data lakes, backups, and big data analytics. It distinguishes itself from block storage and file storage, providing a flat storage structure through objects and buckets. Key features include data encryption, access control via IAM policies, and different bucket types optimized for various tasks such as general purpose, directory-specific, or table-based analytics. S3 also enhances data integrity and upload management via multipart uploads, versioning, and checksum validation. Additional services include S3 Object Lambda for real-time data transformation and S3 Batch Operations for large-scale data management tasks.

  8. 8
    Article
    Avatar of communityCommunity Picks·1y

    How we reduced our cloud spending by 20%

    Duolingo successfully reduced its cloud spending by 20% through various methods such as improving observability, removing unnecessary resources, leveraging AWS optimization strategies, and reducing cloud traffic. The key steps included using third-party tools for cost tracking, deleting unused data and services, optimizing compute resource allocation, and refining RDS and EC2 usage strategies. These initiatives not only saved money but also improved code health and engineering practices.

  9. 9
    Article
    Avatar of foojayioFoojay.io·1y

    Run a Java Lambda Function From a Docker image

    Learn how to package and deploy a Java Serverless function using Docker and AWS's new container support. The guide includes step-by-step instructions for setting up a Maven project, creating a Docker image, configuring AWS infrastructure (ECR, IAM roles, policies), and deploying the Lambda function. It also covers both local and remote testing of the deployed function.

  10. 10
    Article
    Avatar of netflixNetflix TechBlog·1y

    Cloud Efficiency at Netflix

    Netflix uses AWS for its cloud infrastructure needs, leveraging a mix of open-source and proprietary solutions to run its platform efficiently. The Data & Insights organization collaborates with engineering teams to share key efficiency metrics, enabling informed business decisions. Netflix's Platform DSE team provides critical insights through the Foundational Platform Data (FPD) and Cloud Efficiency Analytics (CEA) components to help teams understand resource usage and cost. The organization aims for nearly complete cost insight coverage and plans to extend these solutions to other business areas, incorporating predictive analytics and machine learning for optimization.

  11. 11
    Video
    Avatar of teluskoTelusko·1y

    DevOps with AWS: From Basics to Mastery-Live Course

    A weekend live course on DevOps with AWS starts on January 19th, covering essential DevOps practices and tools like Docker, Kubernetes, Jenkins, Ansible, Terraform, and SonarQube. The course includes recorded content on Git and Maven and is suitable for beginners.

  12. 12
    Video
    Avatar of youtubeYouTube·1y

    How I built an AI Teacher with Vector Databases and ChatGPT

    Learn how to build an AI teacher using vector databases and ChatGPT. The process involves using OpenAI's APIs and vector databases to store and retrieve relevant data from video and PDF transcripts. Neon vector database, integrated with PostgreSQL, offers efficient handling of similar content for AI-driven responses. Tools such as AWS Transcribe aid in converting video content to text. This setup aims to provide quick, contextually accurate responses to user queries.

  13. 13
    Article
    Avatar of theburningmonktheburningmonk.com·1y

    Cohesion vs. Coupling

    Cohesion measures how well components within a module or system work together to achieve a single purpose, while coupling describes the extent of dependencies between different modules or systems. High cohesion and low coupling are desired for better system design and maintenance.

  14. 14
    Article
    Avatar of devopsdigestDevOps Digest·1y

    QR Code Generator ( DevOps Project )

    Showcasing a QR Code generator project leveraging modern DevOps practices and cloud-native technologies, with key accomplishments including deploying a microservices application on Amazon EKS using Terraform, implementing CI/CD pipelines with GitHub Actions, configuring secure SSL/TLS encryption, and integrating AWS S3 for scalable storage. The project aims to deepen understanding of cloud-native architectures and automation in modern application deployment.

  15. 15
    Article
    Avatar of golangnutsGo Developers·1y

    Go + AWS - The Boring CI/CD setup using Terraform and GitHub actions.

    Exploring traditional deployment methods using EC2, Load Balancers, and Auto Scaling Groups for a cost-effective and controlled CI/CD setup with Terraform and GitHub Actions. Check out the GoAWS repository for implementation details.

  16. 16
    Article
    Avatar of spaceliftSpacelift·1y

    Karpenter vs. Cluster Autoscaler – Kubernetes Scaling Tools

    Kubernetes provides essential autoscaling capabilities to manage dynamic workloads, with Cluster Autoscaler (CA) and Karpenter being two prominent solutions for cluster-level scaling. CA operates through predefined node groups and integrates with various cloud providers for node management, while Karpenter dynamically provisions nodes based on real-time requirements, offering faster scaling and better resource optimization. Karpenter's flexibility and cost-efficiency make it suitable for dynamic workloads, whereas CA provides stable, predictable scaling. The choice depends on specific workload needs, cloud environments, and operational priorities.

  17. 17
    Article
    Avatar of awsfundamentalsAWS Fundamentals·1y

    AppConfig: Real-Time Feature Toggles

    AppConfig from AWS Systems Manager enables real-time management of feature flags and application configurations, promoting iterative development and reducing risks associated with large deployments. Feature flags allow for gradual rollouts, A/B testing, and dynamic updates without code changes, supporting agile methodologies like trunk-based development. AppConfig includes advanced deployment strategies and integration with CloudWatch for automated rollbacks, ensuring smooth and secure production releases.

  18. 18
    Article
    Avatar of communityCommunity Picks·1y

    How to deploy a static website / app in AWS.

    Deploying a website or app on AWS provides a reliable and scalable platform with a global presence. This guide outlines the steps to deploy a static website using an S3 bucket, including creating the bucket, uploading files, configuring static hosting, optionally registering a custom domain, and enabling CloudFront CDN for better performance.

  19. 19
    Article
    Avatar of newstackThe New Stack·1y

    MapLibre: How a Fork Became a Thriving Open Source Project

    MapLibre emerged as a thriving open source project after Mapbox shifted its map rendering engine to a proprietary license in late 2020. The community, including key contributors supported by corporations like AWS, Meta, and Microsoft, modernized the project by transitioning it from JavaScript to TypeScript. Despite initial challenges, MapLibre has succeeded with significant community and financial backing, and continues to operate with an equal-opportunity advisory board.

  20. 20
    Article
    Avatar of selfhostedselfhosted·1y

    Go + AWS - The Boring CI/CD setup using Terraform and GitHub actions.

    Explore a traditional method for deploying applications using EC2, Load Balancer, and Auto Scaling Group (ASG) on AWS. This approach, implemented through Terraform and GitHub Actions, provides greater control and cost-effectiveness for open-source SaaS solutions. The post includes a repository and a structured guide for setting up deployments.

  21. 21
    Article
    Avatar of communityCommunity Picks·1y

    awslabs/aws-shell: An integrated shell for working with the AWS CLI.

    The aws-shell is a command line interface for AWS, requiring Python and pip for installation. It integrates with AWS CLI and supports autocompletion, profiles, command history, and more. Users can customize their experiences with various toggle options, and the shell provides extensive command documentation. Currently in developer preview, it encourages feedback and feature requests.

  22. 22
    Article
    Avatar of devopsDevOps.com·1y

    Best of 2024: Valkey is Rapidly Overtaking Redis

    Redis made a licensing change to a 'source-available' model, causing the community to fork Redis into Valkey with backing from major companies like AWS, Google Cloud, and Alibaba Cloud. Valkey has quickly gained support and momentum, with significant contributors moving over from Redis. As a result, many businesses are transitioning from Redis to Valkey, potentially challenging Redis's market position.

  23. 23
    Video
    Avatar of youtubeYouTube·1y

    Elixir vs Go (Golang) Performance (Latency - Throughput - Saturation - Availability)

    The post compares the performance of Elixir and Go, focusing on latency, throughput, saturation, and availability. Benchmark tests are conducted on AWS EC2 instances, using Kubernetes for deployment and Prometheus for monitoring. Go consistently outperforms Elixir in all metrics, handling more requests with lower latency and better resource usage. The post details the setup and results of the tests, highlighting the differences in performance and providing graphs for a visual comparison.

  24. 24
    Article
    Avatar of communityCommunity Picks·1y

    Hosting a Next.js (App Router) app on Amazon S3

    This tutorial provides detailed steps to deploy a Next.js App Router app on Amazon S3. It guides you through setting up an S3 bucket with CloudFront distribution, updating Next.js configuration for a static build, and creating necessary AWS resources like ACM certificates and Route 53 DNS settings. It also outlines a simple script to automate uploading static files to S3 and invalidating the CloudFront cache. The tutorial ensures your application is fully serverless, scalable, and cost-effective.

  25. 25
    Video
    Avatar of communityCommunity Picks·1y

    Python (FastAPI) vs Go (Golang) (Round 2) Performance Benchmark

    This post provides a detailed performance benchmark comparison between FastAPI in Python and Golang, highlighting their efficiency in terms of request latency, throughput, CPU and memory usage. The tests include returning hardcoded objects and processing requests involving database operations with Postgres and caching with Memcached, showcasing Golang's superiority in performance. The benchmarks are performed in an AWS environment, and the author discusses various received pull requests aimed at optimizing Python code to potentially match Golang's efficiency.

See all AWS archives