GCP Anthos (GKE) adding support for secure websockets wss://

580 Views Asked by At

Client-side is throwing an error when trying to connect to an Anthos service deployed in an GKE cluster.

WebSocket connection to 'wss://api.beta.tld' failed: Error during WebSocket handshake: Unexpected response code: 503

Client-side can do https request to Anthos service just fine, ie. https://api.beta.tld/ping so it's only the secure websockets that are throwing 503s, I can't use ws:// as browsers blocks all request due to mixed content.

According to GKE docs websockets should be supported out of the box: https://cloud.google.com/kubernetes-engine/docs/concepts/ingress-xlb#support_for_websocket

Cluster is setup as following:


  gcloud container --project ${GOOGLE_PROJECT_ID} clusters create "${CLUSTER_NAME}" \
    --zone ${GOOGLE_COMPUTE_ZONE} \
    --machine-type "e2-small" \
    --disk-type "pd-ssd" \
    --disk-size "10" \
    --preemptible --num-nodes "3" \
    --addons HorizontalPodAutoscaling,HttpLoadBalancing,NodeLocalDNS \
    --enable-autoscaling --min-nodes "1" --max-nodes "9" \
    --release-channel "regular" \
    --enable-ip-alias \
    --enable-autoupgrade \
    --enable-autorepair \
    --max-surge-upgrade 1 \
    --max-unavailable-upgrade 0 \
    --enable-shielded-nodes \
    --shielded-secure-boot

  gcloud container clusters update "${CLUSTER_NAME}" --zone=${GOOGLE_COMPUTE_ZONE} --update-addons=CloudRun=ENABLED,HttpLoadBalancing=ENABLED

  gcloud container clusters get-credentials "${CLUSTER_NAME}" --region ${GOOGLE_COMPUTE_ZONE}

  kubectl patch cm config-domainmapping -n knative-serving -p '{"data":{"autoTLS":"Enabled"}}'

And I am deploying services like so:

    gcloud run deploy \
      --project ${GOOGLE_PROJECT_ID} \
      --platform gke \
      --cluster ${CLUSTER_NAME} \
      --cluster-location ${GOOGLE_COMPUTE_ZONE} \
      --image "gcr.io/${GOOGLE_PROJECT_ID}/${PROJECT_NAME}/${BRANCH}" \
      --set-env-vars "$(tr '\n' ',' < ${ENV_KEY_PRODUCTION})" \
      --min-instances 1 \
      --max-instances 20 \
      "${1}"

I've noticed that the cluster is created with a TCP LoadBlanacer not a https, not sure if that's the issue or how to create cluster with HTTPs load balancer and still work with Anthos.

0

There are 0 best solutions below