Job Description
We are looking for a full-stack Data Engineer to build the backbone of our data infrastructure and own the end-to-end data lifecycle. You will architect enterprise-grade systems and build products that drive digitalisation, while tackling high-volume challenges such as processing half-hourly meter reads for our energy customers.
Your responsibilities will include:
Pipeline Architecture: Design, build, and maintain robust ETL/ELT pipelines to ingest large-scale datasets and high-frequency streams.Enterprise Warehousing: Lead the design and evolution of our enterprise data warehouse, ensuring it is scalable and performant.Modern Transformation: Manage our data transformation layer using Dataform (preferred) or dbt to orchestrate complex, reliable workflows.Quality & Deployment: Implement automated testing frameworks and deploy scalable services using Docker and Kubernetes to ensure...