Google Cloud Storage

Get started with the Cloud Storage target!

Connector Details

NameValue
PlatformGoogle Cloud Storage
Auth TypeOAuth
Sync TypeIncremental
DirectionBidirectional
API versionREST API
Testing AccountGoogle Cloud Storage
Unified SchemaN/A

Connector Versions

NameVersionStageDescription
Google Cloud Storagev1GASupports Google Cloud Storage developer account

How to get your Cloud Storage credentials

Create a Service Account

Navigate to IAM in your Google Cloud Console, and select Create service account

30683068

Create service account

Name the service account and give it a description, like the following, then select Create and continue:

30683068

Fill service account details

Now you can assign the necessary permissions. In this case, I will use the Storage Object Creator role. You could also use a different role with less granular permissions, such as the Storage Admin role, but this is not recommended.

30683068

Assign Storage Object Creator role

Generate the key file

Finally, select Done and navigate to the newly created service account, and head to the Keys section.

30683068

Add Key to Service Account

Select "Create new key" and choose JSON type

This will generate a JSON key to your local machine

Finally, open the JSON file that was downloaded. This file contains the necessary credentials:

708708

Generated GCS credentials

You can copy these credentials to the matching fields in hotglue to configure your GCS target!

Bucket path prefix

The path prefix is the path under which data will be uploaded. This field can include the following parameters:

ParameterValue
{tenant}The user id this job is running for
{date}The current date formatted as YYYYMM
{flow_id}The flow id this job ran for
{env_id}The environment this job ran for
{job_id}The internal hotglue job id

For example, a valid bucket path prefix is data/invoices/{tenant}

Sample Postman Collection