I am using GCP preemptible VMs for my workers. However, GCP limits the in-use addresses to 8. I requested for increase, but they rejected it. I tried to use their NAT, but it seems to be a 1:1 NAT. I was under the impression that NATs allow many to 1 external connections.
Ironically, I need "external" access to hit an API hosted on cloud run, which is only public ip addresses.
Should I go back to AWS? I like preemptible VMs since I don't have to "bid" on a spot price like with AWS. I just want to use the reduce price for a VM for my workload, which last between 5 minutes to 1 hour. I don't want to resubmit over and over a spot request and have it potentially fail. Plus, GCP VMs come up in 30-40s compared to 1 minute or more for AWS ec2 instances.
Let me know if you have an suggestions or if I'm doing something wrong.
Thanks in advance!
When NAT gateway is used the worker VMs don't require public IP(External IP). As per your comment I noticed that a single manually designated IP is being used for NAT gateway & VM worker nodes. This obviously will result in IP conflict. You may want to modify the terraform template so that the worker VMs don't have public IP & the external IP mapped to NAT gateway. Please refer to the link more about NAT gateway