Job Settings

Learn more about the job settings

Datadog Integration

You can configure hotglue to push job events (success or failures) directly to your Datadog events to maintain observability in one platform. To configure, head to your Environment Job Settings, and configure your Datadog Region and API Key.

Once these settings are saved, hotglue will automatically begin pushing job events to your Datadog account!

30183018

Datadog Settings

Custom Storage

In certain cases you may want to snapshot or cache the data that hotglue processes during a specific sync job. By default this is done using hotglue's infrastructure, but you can configure this to be done using your own AWS S3 buckets.

To store either the snapshot or cache data in your own S3 bucket, you need to:

  1. Create an S3 bucket that hotglue will use during jobs
  2. Create an IAM user for hotglue to access this S3 bucket with programmatic credentials (Access Key Id / Secret Access Key pair)
  3. Create an IAM permission policy and attach it to the IAM user. The policy should be as follows:
 {
    "Sid": "VisualEditor0",
    "Effect": "Allow",
    "Action": [
        "s3:DeleteObject",
        "s3:GetObject",
        "s3:PutObject",
        "s3:PutObjectAcl",
        "s3:ListBucket"
    ],
    "Resource": [
        "arn:aws:s3:::<bucket name>",
        "arn:aws:s3:::<bucket name>/*",
        "arn:aws:s3:::<bucket name>",
        "arn:aws:s3:::<bucket name>/*"
    ]
 }
  1. Finally, you can save the bucket name, access key id, and secret access key to your hotglue settings, as pictured below:
hotglue job storage settingshotglue job storage settings

hotglue job custom storage settings


Did this page help you?