Hacker News·2yuseplunk/plunk: The Open-Source Email Platform
Plunk is an open-source email platform built on AWS SES for sending emails from applications. It supports transactional emails, automations, and broadcasts. The platform can be self-hosted using the driaug/plunk Docker image, and detailed deployment instructions are available in the documentation. Contributions are encouraged, with guidelines provided in CONTRIBUTING.md.
DEV·2yHow I got a job at AWS
Transitioning from a mid-level developer to securing a dream job at AWS requires diligent preparation. Key steps include studying coding challenges, attending Amazon's interviewing workshop, developing stories for Amazon's Leadership Principles, learning and applying useful design patterns, understanding trees and O(n) notation, and preparing thoughtful questions for the interviewer. Taking extensive notes and practicing adaptability are crucial for success. The interview process may involve phone screening, coding tests, and several in-person interviews focused on system and software design.
YouTube·2yBuild Nextjs Inventory Management Dashboard & Deploy on AWS | Postgres, Node, Tailwind, EC2, RDS, S3
Learn to build a full-stack inventory management dashboard using Next.js, with a Node.js backend, and deploy it on AWS. The application features dark and light modes, responsive design, and pages for inventory, products, users, settings, and expenses. The frontend uses Redux Toolkit for state management and Tailwind CSS for styling. The backend relies on Node.js and Express.js with Prisma for interacting with a PostgreSQL database, and the deployment involves AWS services like EC2, RDS, Amplify, and S3. Detailed steps for setting up the project, including installing necessary packages and configuring Redux and Tailwind, are also covered.
Community Picks·2yWe documented 50 common DevOps and SecOps tasks – Here’s what we learned.
After documenting 50 common DevOps and SecOps tasks, key takeaways include the importance of effective querying across cloud resources, the impacts of numerous cloud configuration options, the critical role of security in cloud operations, and the manual nature of mitigating automated vendor billing. Blink offers a no-code/low-code platform to help streamline these tasks and create impactful automations efficiently.
Quastor Daily·2yHow Canva Collects 25 Billion Events Per Day
Canva processes over 25 billion events daily using AWS Kinesis, benefiting from its real-time data analysis and cost-saving features. Their data pipeline involves event batching, compression, and enrichment before routing to Snowflake for further analysis. The switch from AWS SQS to Kinesis significantly reduced their costs by 85%.
Awesome Java Newsletter·2yStructured logging in Spring Boot 3.4
Structured logging in Spring Boot 3.4 allows logs to be written in well-defined, machine-readable formats such as JSON. This enables powerful search and analytics capabilities. It supports the Elastic Common Schema (ECS) and Logstash formats and allows for custom formats. Developers can add additional fields to logs for better filtering and analysis. Logs can be output to the console or written to a file for different use cases.
Community Picks·2yBrief overview : AWS EC2 Instance Setup and Secure CI/CD Pipeline with Jenkins
Setting up a secure and efficient CI/CD pipeline on AWS EC2 using Jenkins involves several key steps. Begin by provisioning an AWS EC2 instance and configuring it, followed by securing access through SSH. Install and configure Jenkins, including essential plugins for Docker, SonarQube, and security checks. Build a Jenkins pipeline with stages for workspace preparation, code checkout, static code analysis, and security scanning. Final steps include managing Docker images and deploying the application with reporting mechanisms for stakeholders.
Community Picks·2y10 Things You Can Learn from Netflix’s Architecture
Netflix's architecture, supporting 247 million subscribers, employs a client-backend-CDN system structure to ensure efficient streaming and exceptional user experience. Leveraging AWS for backend scalability, Netflix uses 700 microservices for modularity and ease of maintenance, and implements geographical redundancy for reliability. Through its custom CDN, Open Connect Appliance (OCA), and intelligent content delivery mechanisms, Netflix enhances streaming quality and performance. Additional strategies like efficient transcoding, predictive caching, DRM, and adaptive network handling further ensure a seamless experience across diverse devices and network conditions.
elastic·2yElasticsearch is open source, again
Elasticsearch and Kibana are now open source again with the addition of the AGPL license option. Elastic believes this move will reduce confusion and strengthen their open-source commitment. The decision comes three years after changing the license due to issues with AWS, which ultimately resolved market confusion and bolstered the AWS partnership. Existing licenses (ELv2 and SSPL) remain in place, providing more choices for users.
Community Picks·2yBuilding Production API Services with Encore, TypeScript, and Neon Serverless Postgres
Encore now supports Neon Postgres across all environments, including AWS and GCP. This integration streamlines the development, testing, and production deployment of scalable API services. Encore's TypeScript SDK allows developers to use familiar language for backend development, and Neon offers serverless Postgres for optimized performance without manual management. The post details a step-by-step guide to creating and deploying a URL shortener application using Encore and Neon.
Awesome Go·2yBuild Go Serverless REST APIs and Deploy to AWS using the SAM framework (Amazon Linux 2 Runtime)
Learn how to build and deploy Go serverless REST APIs using AWS SAM framework. The post highlights the deprecation of Go1.x for AWS Lambda, emphasizing the need for up-to-date tutorials. It emphasizes key software development principles such as Infrastructure as Code, good naming conventions, robust testing strategies, availability & scalability, deployment pipelines, observability, and security. A comprehensive example is provided illustrating these principles in a serverless architecture.
Faun·2ySecurely Scale CI/CD with Self-Hosted GitHub Runners on AWS
Utilizing self-hosted GitHub runners on AWS addresses limitations with GitHub’s hosted runners by providing greater control over computing resources, environment customization, security, and integration with internal tools. This setup involves deploying an EC2 instance as a public-facing web server and a private instance as a self-hosted GitHub runner to improve the efficiency, security, and customization of CI/CD workflows. Key steps include configuring Docker, SSH key generation, setting up AWS CLI, and creating CI/CD workflows in GitHub Actions.
Faun·2yBuilding a End to End Multi-Modal RAG System Using AWS Bedrock And Langchain
Learn how to build an end-to-end Retrieval Augmented Generation (RAG) application using AWS Bedrock and Langchain. This project involves loading PDF documents, creating vector embeddings using the Titan model, storing them in a vector store, integrating Cloudy and Llama 2 language models, and building a user-friendly interface with Streamlit. The system efficiently retrieves and summarizes information from PDF files based on user queries.
Community Picks·2yAuthentication with Golang and AWS Cognito
AWS Cognito simplifies user authentication and validation for web and mobile applications. It offers features such as user registration, OAuth token generation, and integration with social logins like Google, Facebook, and GitHub. This guide demonstrates creating endpoints in Golang using the Gin framework to register users, confirm emails, log in, fetch user data via tokens, and update passwords. It emphasizes Cognito's benefits, including built-in account verification, multi-factor authentication, and AWS security.
AWS·2yAnnouncing Karpenter 1.0
Karpenter 1.0 marks the milestone of its APIs graduating from beta to stable, assuring users of consistent API availability in future minor versions. The release includes three new features: the ability to specify disruption reasons for disruption budgets, a forceful disruption mode balancing application availability and security, and an expanded consolidateAfter feature for improved cost-efficiency and application availability management. Karpenter can be used with Amazon EKS or any conformant Kubernetes cluster.
Dreams of Code·2yElasticSearch returning to open source is a big deal.
ElasticSearch has announced a return to open source, transitioning to the AGPL license. This move reverses their 2021 decision to adopt a dual license model due to concerns about AWS's business practices. The shift signals a potential end to the recent trend of companies moving away from open source and could indicate a market shift. Despite positive sentiments from open-source enthusiasts, the company's stock has dropped by 25% in after-hours trading.
freeCodeCamp·2yUltimate AWS Certified Developer Associate (DVA-C02) Course from Andrew Brown
Elevate your AWS skills with the comprehensive AWS Certified Developer Associate (DVA-C02) course by Andrew Brown, now available for free on the freeCodeCamp.org YouTube channel. This 81-hour video course offers expert instruction and hands-on learning covering essential AWS services like Elastic Beanstalk, ECS, DynamoDB, S3, Lambda, and more, to help you master AWS and ace the certification exam.
Quastor Daily·2yHow Canva Collects 25 Billion Events Per Day
Canva collects and processes 25 billion events per day using AWS Kinesis for real-time streaming data. Key highlights include their use of Kinesis Data Streams to ingest data, routing it to Snowflake for processing, and techniques such as event compression to minimize costs, which saved them $600k annually. By switching from AWS SQS to Kinesis, Canva reduced their costs by 85% and ensured low latency and high uptime for their data pipeline.
All Things Distributed·2yContinuous reinvention: A brief history of block storage at AWS
Marc Olson shares his decade-long experience shaping Elastic Block Store (EBS) at AWS. He reflects on its evolution from a basic block storage service to a system delivering over 140 trillion daily operations. Key takeaways include lessons from queueing theory, the effectiveness of incremental improvements, solving noisy neighbor problems, and the importance of performance measurement. The post also highlights significant shifts like transitioning from HDDs to SSDs and moving to Nitro hardware, which enhanced performance metrics substantially. EBS's journey showcases how continuous innovation meets growing customer demands.
ThePrimeTime·2yMicrosoft Is A Blackhole Of Talent And Money
A web developer describes their frustration after being assigned to work on Microsoft Dynamics ERP, critiquing the complex and uninteresting nature of ERP systems. The post highlights issues with repetitive web development tasks, the inefficiencies and slow performance of Microsoft's cloud-hosted ERP solution, and the hidden complexities within seemingly simple tasks. The writer also touches on broader industry issues, such as the financial dominance of AWS for Amazon and the challenges of maintaining large-scale software projects over time.
Bun·2yBun v1.1.25
Bun v1.1.25 introduces significant updates including bug fixes, node:cluster and V8 C++ API support, faster WebAssembly on Windows, and improved S3 upload speeds. The release also enhances Node.js compatibility and supports workers in standalone executables. Additionally, Bun now allows embedding files without importing explicitly and provides a new Bun.embeddedFiles API. Various bugfixes improve stability and performance across several features.
Community Picks·2yAutomating Infrastructure Deployment with Terraform (AWS example)
Learn how to automate the deployment of AWS infrastructure using Terraform. The guide covers prerequisites like setting up AWS credentials and installing Terraform, followed by a detailed breakdown of the Terraform script to configure an AWS EC2 instance, create a security group, and run startup scripts. It also includes tips for storing variables and running Terraform commands to plan and apply the configurations.
Community Picks·2yLLM app dev using AWS Bedrock and Langchain
The post explains how to develop applications using Large Language Models (LLMs) with Amazon Bedrock and Langchain to perform tasks like Question Answering over large document corpora. It introduces the concept of retrieval-augmented generation (RAG), which uses document processing and vector embedding to fetch relevant document chunks for question answering. The process includes setting up LLM and embedding models, loading and splitting documents into chunks, creating a vector database using SingleStoreDB, and performing similarity searches to generate context-aware responses.
