Tested turning Dataflow autoscaling off and increasing number of workers to 32 for retail media pipeline
- The job was taking >5 hrs and we noticed that autoscaling was scaling workers down to like 1-2 workers. - Turning off autoscaling and increasing workers to 32, ended up taking ~30min and cost about $6