ETL

hotglue CLI commands for ETL

Programmatically manage your transformation scripts using the etl commands below.

ETL Download

Description

Clones the remote ETL script saved in hotglue to your local machine.

Sample

$ hotglue etl download [--overwrite] [--downloadTo]
✔ Finished: Verifying user and authorizing.
✔ Finished: Scanning for downloadable files.
ℹ Info: Downloading script files to ./scripts/tap.
✔ Finished: Downloading file: etl.ipynb.
┌───────────┬────────────┐
│ File      │ Status     │
├───────────┼────────────┤
│ etl.ipynb │ Downloaded │
└───────────┴────────────┘

Parameters

OptionDefaultDescription
--overwrite
-o
falseWhen enabled, overwrites any files that already exist locally in the download to directory.
--downloadTo
-d
.The directory to download the ETL to. Defaults to the local directory.

ETL Deploy

Description

Deploys the local ETL script to hotglue.

Sample

$ hotglue etl deploy [--sourceFolder]
✔ Finished: Verifying user and authorizing.
✔ Finished: Validating flow and tap location.
✔ Finished: Preparing deployment target.
ℹ Info: Deploying ETL scripts.
✔ Finished: Pushing file: default/flows/bTHIweD0W/taps/cin7/etl/etl.ipynb.
┌─────────────────────────────────────────────────┬──────────┐
│ File                                            │ Status   │
├─────────────────────────────────────────────────┼──────────┤
│ default/flows/bTHIweD0W/taps/cin7/etl/etl.ipynb │ Deleted  │
├─────────────────────────────────────────────────┼──────────┤
│ default/flows/bTHIweD0W/taps/cin7/etl/etl.ipynb │ Deployed │
└─────────────────────────────────────────────────┴──────────┘

Parameters

OptionDefaultDescription
--sourceFolder
-s
.The directory to upload the ETL script from. Defaults to the local directory.

ETL Delete

Description

Deletes a deployed ETL script on hotglue.

Sample

$ hotglue etl delete
ℹ Info: Deleting ETL scripts for Tenant tenantId Flow flowId and Tap tapId to envId.
✔ Finished: Verifying user and authorizing.
✔ Finished: Deleting ETL scripts.
┌───────────┬─────────┐
│ File      │ Status  │
├───────────┼─────────┤
│ etl.ipynb │ Deleted │
└───────────┴─────────┘