Connector Details

Name	Value
Platform	Google Cloud Storage
Auth Type	OAuth
Sync Type	Incremental
Direction	Bidirectional
API version	REST API
Testing Account	Google Cloud Storage
Unified Schema	N/A

Connector Versions

Name	Version	Stage	Description
Google Cloud Storage	v1	GA	Supports Google Cloud Storage developer account

How to get your Cloud Storage credentials

Create a Service Account

Navigate to IAM in your Google Cloud Console, and select Create service account

Name the service account and give it a description, like the following, then select Create and continue:

Now you can assign the necessary permissions. In this case, I will use the Storage Object Creator role. You could also use a different role with less granular permissions, such as the Storage Admin role, but this is not recommended.

Generate the key file

Finally, select Done and navigate to the newly created service account, and head to the Keys section.

Select "Create new key" and choose JSON type

This will generate a JSON key to your local machine

Finally, open the JSON file that was downloaded. This file contains the necessary credentials:

You can copy these credentials to the matching fields in hotglue to configure your GCS target!

Bucket path prefix

The path prefix is the path under which data will be uploaded. This field can include the following parameters:

Parameter	Value
`{tenant}`	The user id this job is running for
`{date}`	The current date formatted as `YYYYMM`
`{flow_id}`	The flow id this job ran for
`{env_id}`	The environment this job ran for
`{job_id}`	The internal hotglue job id

For example, a valid bucket path prefix is data/invoices/{tenant}