Containerized HPCC Systems Secrets

This example demonstrates HPCC use use of Hashicorp Vault secrets using kubernetes authentication.

This example assumes you are starting from a linux command shell in the HPCC-Platform/helm directory. From there you will find the example files and this README file in the examples/secrets directory.

Hashicorp Vault support:

This example uses Hashicorp vault. The following steps can be used to set up a development mode only instance of vault just for the purposes of this example. This makes it easy to test out vault functionality without going through the much more extensive configuration process for a production ready vault installation.

Install hashicorp vault command line client:

https://learn.hashicorp.com/tutorials/vault/getting-started-install

---

Install hashicorp vault service in dev mode:

This is for development only, never deploy this way in production. Deploying in dev mode sets up an in memory kv store that won't persist secret values across restart, and the vault will automatically be unsealed.

In dev mode the default root token is simply the string "root".

Add Hashicorp helm repo:

helm repo add hashicorp https://helm.releases.hashicorp.com

Install vault server.

Note that a recent change to the developer mode vault means that you have to set the VAULT_DEV_LISTEN_ADDRESS environment variable as shown in order to access the vault service from an external pod.

helm install vault hashicorp/vault --set "server.dev.enabled=true" --set 'server.extraEnvironmentVars.VAULT_DEV_LISTEN_ADDRESS=0.0.0.0:8200'

Setting up vault

Tell the vault command line application the server location (dev mode is http, default location is https)

export VAULT_ADDR=http://127.0.0.1:8200

In a separate terminal window start vault port forwarding.

kubectl port-forward vault-0 8200:8200

Login to the vault command line using the vault root token (development mode defaults to "root"):

vault login root

If you don't provide the token on the command line you will be prompted to input the value and it will be hidden from view.

Configure vault kubernetes auth

Enabling kubernetes auth will allow k8s nodes to access the vault via their kubernetes.io access tokens.

vault auth enable kubernetes

Exec into the vault-0 pod:

kubectl exec -it vault-0 /bin/sh

Configure vault kubernetes auth:

vault write auth/kubernetes/config \
   token_reviewer_jwt="$(cat /var/run/secrets/kubernetes.io/serviceaccount/token)" \
   kubernetes_host=https://${KUBERNETES_PORT_443_TCP_ADDR}:443 \
   kubernetes_ca_cert=@/var/run/secrets/kubernetes.io/serviceaccount/ca.crt

Exit from the vault-0 pod:

exit

Setup vault auth policy granting access to the ecl secrets locations we plan to use:

vault policy write hpcc-kv-ro examples/secrets/hpcc_vault_policies.hcl

Setup hpcc-vault-access auth role within the default service account (if necessary change bound_service_account "names" and "namespace" to match the service account the HPCC deployment is using):

vault write auth/kubernetes/role/hpcc-vault-access \
        bound_service_account_names="*" \
        bound_service_account_namespaces=default \
        policies=hpcc-kv-ro \
        ttl=24h

'eclUser' category secrets

Create example vault 'eclUser' secrets:

vault kv put secret/eclUser/vault-example crypt.key=@examples/secrets/crypt.key

'ecl' category secrets

Secrets in the 'ecl' category are not accessible by ECL code directly and therefore not visible to ECL users. They can be used by internal ECL feartures and commands. For example:

HTTP-CONNECT Secrets:

This example focuses on ECL secrets to provide HTTP connection strings and credentials for ECL SOAPCALL and HTTPCALL commands.

These secrets are prefixed with the string "http-connect-" requiring this prefix ensures that HTTPCALL/SOAPCALL only accesses secrets which are intended for this use.

HTTP-CONNECT secrets consist of a url string and optional additional secrets associated with that URL. Requiring the url to be part of the secret prevents credentials from being easily hijacked via an HTTPCALL to an arbitrary location. Instead the credentials are explicitly associated with the provided url.

Besides the URL values can currently be set for proxy (trusted for keeping these secrets), username, and password.

Creating the HTTP-CONNECT Secrets

Create example vault secret:

Create example vault 'ecl' secrets:

vault kv put secret/ecl/http-connect-vaultsecret url=@examples/secrets/url-basic username=@examples/secrets/username password=@examples/secrets/password

vault kv put secret/ecl/http-connect-basicsecret url=@examples/secrets/url-basic username=@examples/secrets/username password=@examples/secrets/password

Installing the HPCC with the secrets added to ECL components

Install the HPCC helm chart with the secrets just defined added to all components that run ECL.

helm install myhpcc hpcc/ --set global.image.version=latest -f examples/secrets/values-secrets-k8sauth.yaml

Use kubectl to check the status of the deployed pods. Wait until all pods are running before continuing.

kubectl get pods

---

If you don't already have the HPCC client tools installed please install them now:

https://hpccsystems.com/download#HPCC-Platform

Using the created 'eclUser' category secrets directly in ECL code

The following ecl command will run the example ECL file that demonstrates accessing a vault secret directly from ECL code.

ecl run hthor examples/secrets/crypto_vault_secret.ecl

The expected result would be:

<Result>
<Dataset name='vault_message'>
 <Row><vault_message>For your eyes only</vault_message></Row>
</Dataset>
</Result>

Using the created 'ecl' category secrets via HTTPCALL from within ECL code

If you don't already have the HPCC client tools installed please install them now:

https://hpccsystems.com/download#HPCC-Platform

---

The following ecl command will run the example ECL file that demonstrates an HTTPCALL that uses a vault secret for connection and authentication.

ecl run hthor examples/secrets/httpcall_vault.ecl

The expected result would be:

<Result>
<Dataset name='Result 1'>
 <Row><authenticated>true</authenticated></Row>
</Dataset>
</Result>