ETL

hotglue CLI commands for ETL

Programmatically manage your transformation scripts using the etl commands below.

ETL Download

Description

Clones the remote ETL script saved in hotglue to your local machine.

Sample

$ hotglue etl download [--overwrite] [--downloadTo]
✔ Finished: Verifying user and authorizing.
✔ Finished: Scanning for downloadable files.
ℹ Info: Downloading script files to ./scripts/tap.
✔ Finished: Downloading file: etl.ipynb.
┌───────────┬────────────┐
│ File      │ Status     │
├───────────┼────────────┤
│ etl.ipynb │ Downloaded │
└───────────┴────────────┘

Parameters

Option

Default

Description

--overwrite
-o

false

When enabled, overwrites any files that already exist locally in the download to directory.

--downloadTo
-d

.

The directory to download the ETL to. Defaults to the local directory.

ETL Deploy

Description

Deploys the local ETL script to hotglue.

Sample

$ hotglue etl deploy [--sourceFolder]
✔ Finished: Verifying user and authorizing.
✔ Finished: Validating flow and tap location.
✔ Finished: Preparing deployment target.
ℹ Info: Deploying ETL scripts.
✔ Finished: Pushing file: default/flows/bTHIweD0W/taps/cin7/etl/etl.ipynb.
┌─────────────────────────────────────────────────┬──────────┐
│ File                                            │ Status   │
├─────────────────────────────────────────────────┼──────────┤
│ default/flows/bTHIweD0W/taps/cin7/etl/etl.ipynb │ Deleted  │
├─────────────────────────────────────────────────┼──────────┤
│ default/flows/bTHIweD0W/taps/cin7/etl/etl.ipynb │ Deployed │
└─────────────────────────────────────────────────┴──────────┘

Parameters

Option

Default

Description

--sourceFolder
-s

.

The directory to upload the ETL script from. Defaults to the local directory.


Did this page help you?