Job Overview
We are seeking a meticulous Senior QA Engineer / Data Validation Engineer to own the quality assurance, data integrity, and model validation processes for our enterprise Demand Forecasting platform.
Unlike traditional software testing, this role focuses heavily on data accuracy, pipeline reliability, and statistical outcome validation. You will work side-by-side with our Data Science and Data Engineering teams within Azure Databricks and Azure AI Foundry to ensure that data feeding our algorithms is flawless, pipelines are resilient, and the forecasted outputs match expected statistical and business boundaries.
Key Responsibilities
1. Data Integrity & Pipeline Validation
• Design, implement, and execute comprehensive test plans to validate complex ETL/ELT pipelines within Azure Databricks and Azure Data Factory.
• Write advanced SQL queries and Python validation scripts to verify data transformations, aggregations, schema conformance, and data completenes...