Skip to main content

Connecting GCS

This assumes you have already created a GCS bucket and have a pipeline setup to move Parquet, JSON, or CSV files into it.

You will need to create an HMAC key and provide both the access key and secret values of this key for authentication. The google service account associated with the credentials must be granted read and list permissions for the bucket and its objects.

Create an HMAC Key

  1. Log into GCP and open Cloud Storage.
  2. From the left menu, select Settings, then click Interoperability.
  3. Under Service account HMAC, select Create a Key for Another Service Account. You can also create an account if desired at this time. If you do, make note of the name of the service account.
  4. Take note of the access key and secret values. You won't be able to see the secret again.

Grant Access to the Service Account

  1. From the left menu, select Buckets, then navigate to the bucket you wish to sync with Motif.
  2. Click the Permissions tab at the top, then select Grant Access.
  3. Under Add Principals, locate & select the name of the service account you associated with the HMAC key.
  4. Under Assign Roles, select Storage Object Viewer & Storage Object User.

Make note of the following information:

  1. Bucket name
  2. Access Key ID
  3. AWS Secret Access Key
  4. File extension

Follow instructions to share your data source configuration with Motif.