Deploying Gel to Google Cloud​

.md

Copy page

Prerequisites​

• Google Cloud account with billing enabled (or a free trial)

• gcloud CLI (install)

• kubectl CLI (install)

Make sure you are logged into Google Cloud.

$ 

gcloud init

Create a project​

Set the PROJECT environment variable to the project name you'd like to use. Google Cloud only allow letters, numbers, and hyphens.

$ 

PROJECT=gel

Then create a project with this name. Skip this step if your project already exists.

$ 

gcloud projects create $PROJECT

Then enable the requisite APIs.

$ 
  
  
  
  

gcloud services enable \
  container.googleapis.com \
  sqladmin.googleapis.com \
  iam.googleapis.com \
  --project=$PROJECT

Provision a Postgres instance​

Use the read command to securely assign a value to the PASSWORD environment variable.

$ 

echo -n "> " && read -s PASSWORD

Then create a Cloud SQL instance and set the password.

$ 
  
  
  
  
  
  

gcloud sql instances create ${PROJECT}-postgres \
  --database-version=POSTGRES_17 \
  --edition=enterprise \
  --cpu=1 \
  --memory=3840MiB \
  --region=us-west2 \
  --project=$PROJECT

$ 
  
  
  

gcloud sql users set-password postgres \
  --instance=${PROJECT}-postgres \
  --password=$PASSWORD \
  --project=$PROJECT

Create a Kubernetes cluster​

Create an empty Kubernetes cluster inside your project.

$ 
  
  
  

gcloud container clusters create ${PROJECT}-k8s \
  --zone=us-west2-a \
  --num-nodes=1 \
  --project=$PROJECT

Configure service account​

Create a new service account, configure its permissions, and generate a credentials.json file.

$ 
  

gcloud iam service-accounts create ${PROJECT}-account \
  --project=$PROJECT

$ 

MEMBER="${PROJECT}-account@${PROJECT}.iam.gserviceaccount.com"

$ 
  
  
  

gcloud projects add-iam-policy-binding $PROJECT \
  --member=serviceAccount:${MEMBER} \
  --role=roles/cloudsql.admin \
  --project=$PROJECT

$ 
  

gcloud iam service-accounts keys create credentials.json \
  --iam-account=${MEMBER}

Then use this credentials.json to authenticate the Kubernetes CLI tool kubectl.

$ 

gcloud components install gke-gcloud-auth-plugin

$ 
  

kubectl create secret generic cloudsql-instance-credentials \
  --from-file=credentials.json=credentials.json

$ 
  
  
  
  

INSTANCE_CONNECTION_NAME=$(
  gcloud sql instances describe ${PROJECT}-postgres \
      --format="value(connectionName)" \
      --project=$PROJECT
)

$ 

DSN="postgresql://postgres:${PASSWORD}@127.0.0.1:5432"

$ 
  
  
  

kubectl create secret generic cloudsql-db-credentials \
  --from-literal=dsn=$DSN \
  --from-literal=password=$PASSWORD \
  --from-literal=instance=${INSTANCE_CONNECTION_NAME}=tcp:5432

Deploy Gel​

Download the starter Gel Kubernetes configuration file. This file specifies a persistent volume, a container running a Cloud SQL authorization proxy, and a container to run Gel itself. It relies on the secrets we declared in the previous step.

$ 

wget "https://raw.githubusercontent.com\
/geldata/gel-deploy/dev/gcp/deployment.yaml"

$ 

kubectl apply -f deployment.yaml

Ensure the pods are running.

$ 

kubectl get pods

NAME                     READY   STATUS              RESTARTS   AGE
gel-977b8fdf6-jswlw      0/2     ContainerCreating   0          16s

The READY 0/2 tells us neither of the two pods have finished booting. Re-run the command until 2/2 pods are READY.

If there were errors you can check Gel's logs with:

$ 

kubectl logs deployment/gel --container gel

Persist TLS Certificate​

Now that our Gel instance is up and running, we need to download a local copy of its self-signed TLS certificate (which it generated on startup) and pass it as a secret into Kubernetes. Then we'll redeploy the pods.

$ 
  
  
  
  
  
  
  
  

kubectl create secret generic cloudsql-tls-credentials \
  --from-literal=tlskey="$(
      kubectl exec deploy/gel -c=gel -- \
          gel-show-secrets.sh --format=raw GEL_SERVER_TLS_KEY
  )" \
  --from-literal=tlscert="$(
      kubectl exec deploy/gel -c=gel -- \
          gel-show-secrets.sh --format=raw GEL_SERVER_TLS_CERT
  )"

$ 

kubectl delete -f deployment.yaml

$ 

kubectl apply -f deployment.yaml

Expose Gel​

$ 

kubectl expose deploy/gel --type LoadBalancer

Get your instance's DSN​

Get the public-facing IP address of your database.

$ 

kubectl get service

NAME         TYPE           CLUSTER-IP  EXTERNAL-IP   PORT(S)
gel          LoadBalancer   <ip>        <ip>          5656:30841/TCP

Copy and paste the EXTERNAL-IP associated with the service named gel. With this IP address, you can construct your instance's DSN:

$ 

GEL_IP=<copy IP address here>

$ 

GEL_DSN="gel://admin:${PASSWORD}@${GEL_IP}"

To print the final DSN, you can echo it. Note that you should only run this command on a computer you trust, like a personal laptop or sandboxed environment.

$ 

echo $GEL_DSN

The resuling DSN can be used to connect to your instance. To test it, try opening a REPL:

$ 

gel --dsn $GEL_DSN --tls-security insecure

Gel x.x (repl x.x)
Type \help for help, \quit to quit.
gel> select "hello world!";

$ 
  
  
  
  
  

echo $PASSWORD | gel instance link \
  --dsn $GEL_DSN \
  --password-from-stdin \
  --non-interactive \
  --trust-tls-cert \
  gcp_instance

$ 

gel -I gcp_instance

$ 

gel -I gcp_instance migrate

Health Checks​

Using an HTTP client, you can perform health checks to monitor the status of your Gel instance. Learn how to use them with our health checks guide.