open source
Tools I build with.
Reusable pieces from my own pipeline and BI work, released under the MIT license. Use them as they are, or get in touch to have them set up for your stack.
Pipelines
sql_job_runner
Config-driven SQL jobs. Write the query, describe the job in YAML, and the runner handles execution, export, validation, and delivery.
- YAML job definitions with Jinja2-templated SQL
- Runs on any SQLAlchemy engine, from PostgreSQL to SQLite
- Exports to CSV, Parquet, or Excel, with validation that fails fast on data loss
- Plugins for SFTP, S3 and GCS, email, Slack, and database loads
PythonSQLAlchemyJinja2pandasYAML
Tableau
tableau-admin-toolkit
Run every site in a multi-tenant Tableau Server or Tableau Cloud deployment from one YAML file.
- Idempotent site bootstrap: projects, groups, users, and permissions
- Batch publishing of workbooks and data sources to every site
- Resumable Server-to-Cloud content migration
- Extract-failure alerts and dashboard-to-database validation
PythonTableau REST APIConnected Apps (JWT)TyperPydantic
Connectors
conduits
Composable connectors and pipeline building blocks for data ingestion.
- Source connectors and sinks, from public data APIs to Excel and the filesystem
- Reusable pipeline base classes
- CLI examples and Airflow DAGs for running pipelines on a schedule
PythonpandasApache Airflow