Post

Dyvenia — Enterprise Data Pipelines on Kubernetes

10M+ records, 99.9% data quality, 60% faster ETL — Atttiva/IDflow product line.

Dyvenia — Enterprise Data Pipelines on Kubernetes

Dyvenia · Remote (Tenerife, Spain) · Mar 2023 – Jan 2025
Role: Senior Data Engineer (employee)

Highlights

  • Developed enterprise data pipelines in Kubernetes processing 10M+ records with 99.9% data quality checks
  • Optimized ETL/ELT jobs (PostgreSQL, Parquet, dbt) — 60% faster report processing
  • Improved infrastructure efficiency via database and cache tuning
  • Introduced test-first delivery and versioned releases

Primary product

Atttiva / IDflow — primary engagement (~588 unique commits across canonical repos). ETL, k8s deployments, dbt models, data quality gates.

Other contributions

  • Dyvenia CI templates (ci-tests, pipeline templates)
  • viadot — feature branches and PR reviews
  • VELUX Azure client work

Scale

~625 unique author commits (hash-deduped across employer archive).

Tech stack

Python · Kubernetes · PostgreSQL · dbt · Parquet · Azure (client work)

This post is licensed under CC BY 4.0 by the author.