ENGINEERING NOTEJune 10, 20251 min read
How We Reduced AWS Costs by 45% using Serverless Fine-Tuning
Auditing idle resources, sizing ECS Fargate tasks precisely, and using spot instances for offline batch ML jobs.
Cloud expenses easily spin out of control. By auditing our compute footprint, we migrated static configurations to highly dynamic spot instance orchestrators.
This post details sizing memory parameters, scheduling off-hour auto-scale policies, and running non-critical inference queues on serverless workers.
WRITTEN BY
Shubham Mukherjee
Full Stack & AI Engineer crafting high-performance web applications and intelligent machine learning systems.