Functions for exporting data to various formats and handling errors in ETL pipelines
data
(pd.DataFrame): DataFrame to exportname
(str): Output file name/stream nameoutput_dir
(str): Directory for output fileskeys
(list): Primary key fieldsunified_model
(pydantic.BaseModel): Pydantic model for schema validationexport_format
(str): Output format (‘singer’, ‘parquet’, ‘json’, ‘jsonl’, ‘csv’)output_file_prefix
(str): Optional prefix for output filesschema
(dict): Custom schema for Singer formatstringify_objects
(bool): Convert complex objects to strings for Parquetdf
(pd.DataFrame): DataFrame to exportstream
(str): Singer stream nameoutput_dir
(str): Output directorykeys
(list): Primary key fieldsfilename
(str): Output filename (default: ‘data.singer’)allow_objects
(bool): Enable complex object handlingschema
(dict): Custom schema definitionunified_model
(pydantic.BaseModel): Pydantic model for validation