A developer discusses the monthly infrastructure costs of running Firebender, an AI coding tool for Android Studio. The autocomplete model alone requires a cluster of eight H100 GPUs costing $10K–$30K per month. The conversation highlights the competitive GPU market where startups compete with OpenAI, Anthropic, and Microsoft for H100 access, with H200s from Nvidia also on the horizon.

1m watch time

Sort: