Dyvenia — Enterprise Data Pipelines on Kubernetes
10M+ records, 99.9% data quality, 60% faster ETL — Atttiva/IDflow product line.
Dyvenia — Enterprise Data Pipelines on Kubernetes
Dyvenia · Remote (Tenerife, Spain) · Mar 2023 – Jan 2025
Role: Senior Data Engineer (employee)
Highlights
- Developed enterprise data pipelines in Kubernetes processing 10M+ records with 99.9% data quality checks
- Optimized ETL/ELT jobs (PostgreSQL, Parquet, dbt) — 60% faster report processing
- Improved infrastructure efficiency via database and cache tuning
- Introduced test-first delivery and versioned releases
Primary product
Atttiva / IDflow — primary engagement (~588 unique commits across canonical repos). ETL, k8s deployments, dbt models, data quality gates.
Other contributions
- Dyvenia CI templates (
ci-tests, pipeline templates) - viadot — feature branches and PR reviews
- VELUX Azure client work
Scale
~625 unique author commits (hash-deduped across employer archive).
Tech stack
Python · Kubernetes · PostgreSQL · dbt · Parquet · Azure (client work)
This post is licensed under CC BY 4.0 by the author.