Best of AWS — October 2024

  1. 1
    Video
    Avatar of youtubeYouTube·2y

    Build a Nextjs Project Management App & Deploy on AWS | Cognito, EC2, Node, RDS, Postgres, Tailwind

    In this detailed guide, Ed Row demonstrates building and deploying a full-stack project management application using Nextjs, Node.js, and AWS. The application includes features like task drag-and-drop, multiple views (list, timeline, table), and user authentication via AWS Cognito. The front end utilizes Nextjs with Redux Toolkit for state management and Tailwind CSS for styling. The backend is handled by Node.js with Express and Prisma for database interactions. AWS services such as EC2, RDS, and Amplify are used for deployment, ensuring the application is scalable and enterprise-ready.

  2. 2
    Article
    Avatar of bytebytegoByteByteGo·2y

    EP135: Big Data Pipeline Cheatsheet for AWS, Azure, and Google Cloud

    The post covers a variety of topics crucial for engineering leaders, including big data pipelines for AWS, Azure, and Google Cloud. It provides a detailed cheatsheet for key services like data ingestion, storage, processing, and visualization on each platform. It also discusses API architectural styles and offers a concise guide for building secure APIs. Additionally, there's a resource on key data structures used daily and an advertisement for an enterprise conference and a mini crash course on advanced AI tools.

  3. 3
    Video
    Avatar of freecodecampfreeCodeCamp·2y

    Generative AI for Developers – Comprehensive Course

    This comprehensive course on generative AI covers essential concepts like large language models, data preprocessing, and advanced techniques such as fine-tuning and prompt engineering. Through hands-on projects using tools like Hugging Face, OpenAI, and LangChain, participants will learn to build real-world applications including text summarization and custom chatbots. The course also delves into vector databases, AI pipelines, and deployment techniques using platforms like Google Cloud Vertex AI and AWS Bedrock.

  4. 4
    Article
    Avatar of communityCommunity Picks·2y

    why client-side environment variables are a bad idea

    Discusses the potential dangers and security risks associated with using client-side environment variables for storing sensitive information, illustrated through a specific case involving Gamersafer. Through detailed recounting of how AWS keys were exposed and the implications thereof, it underscores the importance of server-side API calls for handling sensitive data.

  5. 5
    Article
    Avatar of communityCommunity Picks·2y

    The greatest resume I've ever seen

    Daniel Singletary transitioned from being a plumber to a cloud DevOps engineer through hard work and completing the Cloud Resume Challenge. Despite having no professional IT experience, his resume showcased his strong troubleshooting, collaboration, and testing skills honed in plumbing. Daniel's story demonstrates how non-traditional backgrounds can lead to successful tech careers through perseverance and skill-building.

  6. 6
    Article
    Avatar of dhhDavid Heinemeier Hansson·2y

    Our cloud-exit savings will now top ten million over five years

    37signals has successfully transitioned several cloud applications, including Basecamp and HEY, from AWS to their own hardware. This move resulted in estimated savings of over $10 million over five years. They achieved this by utilizing existing data center infrastructure and efficiently managing new Dell hardware and Pure Storage setups. Although the cloud offers benefits in early stages or for fluctuating loads, significant cost savings can be realized by analyzing and transitioning substantial workloads to owned hardware.

  7. 7
    Article
    Avatar of freecodecampfreeCodeCamp·2y

    Prepare to Pass the AWS Certified AI Practitioner Certification

    The AWS Certified AI Practitioner certification validates your understanding of AI, ML, and generative AI concepts. A comprehensive free course is available on freeCodeCamp’s YouTube channel, developed by Andrew Brown, to help you prepare and pass the exam. This certification is ideal for those familiar with AI/ML technologies on AWS and can lead to significant salary increases across various roles. The course covers essential topics like AI and ML fundamentals, data, generative AI, SageMaker, and AWS Managed ML.

  8. 8
    Article
    Avatar of threedotslabsThree Dots Labs·2y

    Watermill 1.4 Released (Event-Driven Go Library)

    Watermill 1.4, an event-driven Go library, has seen significant updates. Key highlights include support for a new universal requeuer component that works with all Pub/Subs (requiring PostgreSQL for now), a pq CLI tool for managing poison queues, and a delay package to add delay metadata to messages. There's also enhanced support for AWS SNS/SQS Pub/Subs and major updates to watermill-amqp and watermill-sql. The new release includes refreshed documentation, a new logo, and several new examples showcasing features like delayed messages and distributed transactions.

  9. 9
    Article
    Avatar of newstackThe New Stack·2y

    The Top 5 Python Packages and What They Do

    Discover the top five Python packages currently leading in the PyPI rankings. These include boto3, urllib3, botocore, aiobotocore, and Requests. Boto3, botocore, and aiobotocore are essential for interacting with AWS services. Urllib3 and Requests simplify HTTP requests. Learn their key features and installation commands.

  10. 10
    Article
    Avatar of medium_jsMedium·2y

    Optimizing AWS EKS: How to Use One Load Balancer for Multiple Subdomains

    Using a single AWS Application Load Balancer (ALB) for multiple subdomains in an EKS cluster can significantly reduce costs and simplify management. This method involves configuring Ingress resources to route traffic for different subdomains through one ALB. Key steps include installing the AWS Load Balancer Controller, creating a security group for controlled access, defining Ingress and service configurations, and applying these configurations using `kubectl`. This setup enhances resource efficiency and security, especially when managing internal tools or services within an EKS cluster.

  11. 11
    Video
    Avatar of communityCommunity Picks·2y

    The Last Amazon S3 Video You'll Need To Watch (Presigned URLs, Multipart Upload)

    Learn best practices for working with Amazon S3 from a .NET application. This guide covers using the S3 SDK, working with pre-signed URLs, and handling multi-part uploads for large files. Practical tips include navigating the AWS console, configuring S3 buckets, and implementing efficient file upload and download functionalities. Explore examples on configuring CORS and using client-side applications for direct file interactions with S3.

  12. 12
    Article
    Avatar of neontechNeon·2y

    How to create an AWS S3 bucket for Postgres backups

    Learn how to set up an AWS S3 bucket to store Postgres backups, a useful step for managing backups in a multi-tenant architecture. This guide includes setting up AWS Providers and Roles, creating an OIDC Identity Provider and Role, and configuring an S3 bucket with an updated policy. The process involves using GitHub Actions to automate transfers, ideal for handling numerous projects efficiently.

  13. 13
    Video
    Avatar of nickchapsasNick Chapsas·2y

    Adding JWT Authentication for Production in .NET

    Nick demonstrates implementing JWT (JSON Web Token) authentication in .NET applications, focusing not just on simple integration but also on more advanced scenarios with third-party services like AWS Cognito. He covers how to generate and validate JWTs, using AWS Cognito for user management and token generation, and integrating this with a .NET API to secure endpoints. Additionally, examples include setting up Cognito user pools and handling both basic token validation and more complex authentication flows.

  14. 14
    Video
    Avatar of webdevcodyWeb Dev Cody·2y

    Why eventual consistency is important to learn

    Eventual consistency is a database concept where data across multiple regions becomes consistent over time but not immediately. This approach can enhance user experience by reducing latency in global applications but introduces complexities like stale data, especially during writes and reads. Handling stale data and ensuring data integrity requires additional mechanisms such as polling or transactions.

  15. 15
    Article
    Avatar of codemotionCodemotion·2y

    Generative AI Prompt Patterns for Software Engineering

    Developers are transitioning to roles like Prompt Engineers and Code Reviewers as large language models (LLMs) enhance their coding capabilities. Integrating AI tools such as AWS Bedrock for efficient and scalable solutions is crucial. Key generative AI prompt patterns include Full-Context Code Analysis, LLM Method Replacement, Context Reducer, and Comments Replacement, which improve code quality and streamline workflows. Collaboration between human expertise and AI is essential for advanced, adaptable software development.

  16. 16
    Article
    Avatar of freecodecampfreeCodeCamp·2y

    How Message Queues Help Make Distributed Systems More Reliable

    Reliable systems consistently perform their intended functions under various conditions while minimizing downtime and failures. Message queues enhance flexibility and fault tolerance in distributed systems by enabling asynchronous communication, buffering messages, and allowing components to work independently. They play a crucial role in load distribution, data replication, and capacity planning. However, message queues also come with challenges, such as ensuring message order and idempotent processing. Examples using AWS SQS and Python illustrate practical implementation.

  17. 17
    Article
    Avatar of devopslifeDevOps Life·2y

    Docker backing up PosgreSQL dabatase to Local, AWS S3, FTP and SSH remote storage

    Learn how to easily backup a PostgreSQL database using Docker with the `jkaninda/pg-bkup` tool. This solution supports saving backups to local storage, AWS S3, FTP, and SSH remote storage. Key parameters include setting the database host, username, password, and scheduling the backup with a cron expression.

  18. 18
    Article
    Avatar of communityCommunity Picks·2y

    How to Integrate Next-Auth with Your Next.js Application

    Learn how to integrate Auth.js with your Next.js 14 application to handle authentication processes, including both credentials and Google social login. The guide provides step-by-step instructions to set up necessary environment variables, configure authentication, create custom pages, and protect routes using Next.js middleware.

  19. 19
    Article
    Avatar of grafanaGrafana Labs·2y

    Grafana's Prometheus libraries: How we built libraries to create a truly vendor-neutral data source

    Grafana Labs has decoupled its Prometheus data source from Grafana, enabling the creation of vendor-neutral data sources. This update includes a dedicated Amazon Managed Service for Prometheus plugin while maintaining core functionalities and stability. The change aims to foster better observability and reusability in the open-source community. Key principles like DRY and modularity were emphasized, and significant efforts ensured the code's independence and scalability. The project required extensive internal collaboration, POCs, and CI/CD enhancements to achieve this milestone.

  20. 20
    Article
    Avatar of gitguardianGitGuardian·2y

    Docker Zombie Layers: Why Deleted Layers Can Still Haunt You

    Unreferenced Docker image layers, known as 'zombie layers', persist in registries even after being removed from a manifest, potentially posing security risks if they contain sensitive data. These layers can linger for weeks before being removed by registry garbage collectors. While tools exist to remove such layers, the persistence of these layers highlights the importance of vigilant monitoring and immediate revocation of exposed secrets.

  21. 21
    Article
    Avatar of hnHacker News·2y

    Forceu/Gokapi: Lightweight selfhosted Firefox Send alternative without public upload. AWS S3 supported.

    Gokapi is a lightweight, self-hosted file-sharing server similar to the discontinued Firefox Send. Only the admin can upload files, which expire after a set number of downloads or days. The server supports AWS S3 and Backblaze B2 for storage, offers deduplication for identical files, and includes end-to-end encryption. Customization is straightforward with HTML/CSS knowledge, and it can be deployed quickly using Docker or bare metal setups.

  22. 22
    Article
    Avatar of rubylaRUBYLAND·2y

    Secrets Management Best Practices and Tools

    Charles and Valentino, joined by Brian Vallelunga of Doppler, discuss best practices for managing sensitive information like API and encryption keys. They highlight tools such as AWS Secrets Manager, Docker, and Doppler. The conversation includes the repercussions of data breaches, real-world scams, and ensuring developer efficiency and security. Emerging trends like passwordless authentication are also explored, offering insights into future developments in secrets management.

  23. 23
    Video
    Avatar of webdevcodyWeb Dev Cody·2y

    You'll eventually need to learn eventual consistency

    Understanding eventual consistency is crucial in software engineering, especially when using solutions like AWS Aurora with multi-region setups. This concept allows for faster data access in different regions by using replicas but can result in users fetching stale data due to delayed replication. Being aware of these issues is important for building robust systems.

  24. 24
    Article
    Avatar of lobstersLobsters·2y

    Migrating from AWS to Self-Hosting ⚡ Zig Programming Language

    Ziglang.org transitioned from AWS S3 + CloudFront to a more cost-effective self-hosting solution using a Hetzner instance. The motivation behind this move was to reduce high AWS costs, highlighting that 99% uptime is sufficient for their needs. By doing this, they aim to cut expenses and allocate more funds to pay contributors. Future plans include providing torrent files for releases to further optimize resource use.

  25. 25
    Article
    Avatar of detlifeData Engineer Things·2y

    DynamoDB Architecture and Its Key Features.

    Amazon DynamoDB is a fully managed, serverless key-value and document database that ensures single-digit millisecond performance at any scale. Handling trillions of daily requests, DynamoDB is designed with core properties like limitless scalability, consistent performance, high availability, and durability. The system integrates a multi-tenant architecture and supports various capacity modes, secondary indexes, and transactions. Designed for high availability, it employs synchronous write and consistent read operations regulated by the Paxos algorithm, and employs advanced techniques like continuous verification to prevent data corruption.

See all AWS archives