Best of FinOps — October 2024

1. 1
   Article

   David Heinemeier Hansson·2y

   Our cloud-exit savings will now top ten million over five years

   37signals has successfully transitioned several cloud applications, including Basecamp and HEY, from AWS to their own hardware. This move resulted in estimated savings of over $10 million over five years. They achieved this by utilizing existing data center infrastructure and efficiently managing new Dell hardware and Pure Storage setups. Although the cloud offers benefits in early stages or for fluctuating loads, significant cost savings can be realized by analyzing and transitioning substantial workloads to owned hardware.

   32

   2
2. 2
   Article

   databricks·2y

   Building a Cost-Optimized Chatbot with Semantic Caching

   Chatbots are useful tools for businesses, enhancing efficiency and supporting employees by providing informed responses. However, high-performing models can be expensive to query at scale. A cost-saving strategy, semantic caching, reuses responses for similar questions, reducing redundant computations. Databricks offers an optimal platform for implementing this approach, providing necessary components like Vector Search and MLflow. While semantic caching can reduce costs and latency, slight declines in response quality must be weighed against these benefits. Databricks Mosaic AI efficiently supports these implementations with robust governance and model evaluation tools.

   20
3. 3
   Article

   Lobsters·2y

   Migrating from AWS to Self-Hosting ⚡ Zig Programming Language

   Ziglang.org transitioned from AWS S3 + CloudFront to a more cost-effective self-hosting solution using a Hetzner instance. The motivation behind this move was to reduce high AWS costs, highlighting that 99% uptime is sufficient for their needs. By doing this, they aim to cut expenses and allocate more funds to pay contributors. Future plans include providing torrent files for releases to further optimize resource use.

   13