DEV·4ySystem Design: Netflix
Netflix is a subscription-based streaming service that allows its members to watch TV shows and movies on an internet-connected device. The system should meet the following requirements: Users should be able to stream and share videos. This API will allow our users to post a comment on a video (like YouTube) The tweet service will handle video streaming-related functionality. It will be discussed in detail separately.
Medium·4yHow we reduced our annual server costs by 80% — from $1M to $200k — by moving away from AWS
Prerender saved $800k by removing their reliance on AWS and building in-house infrastructure Combined with AWS, we had already cut our expenses by 22%. The testing phase was crucial to make sure the following processes would run smoothly. After testing whether Prerender pages could be cached in both S3 and minio, we slowly diverted traffic away from AWS S 3 and towards minio.
DEV·4yThe Complete List of Heroku Alternatives to Consider
Heroku will be shutting down its free tier in the coming months. Starting October 26, 2022, we will begin deleting inactive accounts and associated storage for accounts that have been inactive for over a year. Some people are looking for free alternatives to replace their current Heroku arrangement. Some are smaller companies that are just getting started.
AWS Tip·4yBuilding an API using Serverless framework
Serverless is a way to build and run applications & services without having to manage servers. There are 40+ Lambda templates for the most common use cases (e.g. microservice-http-endpoint, dynamodb-process-stream, sns-message, sqs-poller, s3-get-object, etc. You only pay for the time that Lambdas work.
Fly.io·4yIntroducing LiteFS
LiteFS works by interposing a very thin virtual file system between your app and your on-disk database file. The FUSE file system solves many of these usability issues by being a single point that all database calls go through. LiteFS also needs to run an API server to replicate data between nodes. It uses Hashicorp's Consul to determine the primary node in your cluster.
HEARTBEAT·4yIs there a Data Engineering Roadmap?
Data Engineering is the discipline in the 'Data World' which drives us to design and build things. Data Engineers need to know how to manage, create, and design databases being relational or non-relational, how the data on them can be normalized, and understand the Entity-Relationship model, normalization and scaling patterns.