Connecting GCS
This assumes you have already created a GCS bucket and have a pipeline setup to move Parquet, JSON, or CSV files into it.
You will need to create an HMAC key and provide both the access key
and
secret
values of this key for authentication. The google service account
associated with the credentials must be granted read and list permissions for
the bucket and its objects.
Create an HMAC Key
- Log into GCP and open Cloud Storage.
- From the left menu, select Settings, then click Interoperability.
- Under Service account HMAC, select Create a Key for Another Service Account. You can also create an account if desired at this time. If you do, make note of the name of the service account.
- Take note of the
access key
andsecret
values. You won't be able to see the secret again.
Grant Access to the Service Account
- From the left menu, select Buckets, then navigate to the bucket you wish to sync with Motif.
- Click the Permissions tab at the top, then select Grant Access.
- Under Add Principals, locate & select the name of the service account you associated with the HMAC key.
- Under Assign Roles, select Storage Object Viewer & Storage Object User.
Make note of the following information:
Bucket name
Access Key ID
AWS Secret Access Key
File extension
Follow instructions to share your data source configuration with Motif.