Bragdocs
Log in Sign up

← Tim

January 24th, 2024

Tested turning Dataflow autoscaling off and increasing number of workers to 32 for retail media pipeline

- The job was taking >5 hrs and we noticed that autoscaling was scaling workers down to like 1-2 workers. 
- Turning off autoscaling and increasing workers to 32, ended up taking ~30min and cost about $6