Data Engineer

📍 Location: Hybrid – Cardiff, UK (2-3 days on-site per week)

📅 Duration: Initial 6 months (extensions likely)

💸 Rate: Competitive / Market Rates (Inside IR35)

🚀 Start Date: ASAP

🖥️ Engagement: Contract (Inside IR35)

We’re looking for a Data Quality Engineer to join a dynamic data platform team supporting cloud-native data transformation projects. This role is ideal for engineers passionate about data quality, automation, and ETL testing in cloud environments.

✅ Key Responsibilities:

• Define, build, and maintain test automation frameworks and tools
• Collaborate with developers to shift-left testing and integrate into CI/CD pipelines
• Own and manage the QA process across sprints and releases
• Perform ETL, DWH, and data pipeline testing using tools like SQL, Python, PySpark
• Maintain test automation aligned with BDD (Cucumber or similar)
• Drive best practices, documentation, and quality strategies across the QA function
• Support continuous integration using Azure DevOps, Jenkins, or GitLab
• Liaise with internal teams and stakeholders to ensure robust delivery

🧠 Ideal Candidate Profile:

• Strong hands-on experience in ETL/Data Warehouse Testing using Python or PySpark
• Expertise with SQL, relational databases (preferably Oracle)
• Experience with cloud platforms, ideally GCP (BigQuery, Dataflow, Cloud Functions)
• Proven success implementing automation frameworks and integrating them with pipelines
• Familiarity with CI/CD, BDD (Cucumber), and performance testing (JMeter)
• Experience working with Agile, JIRA, and test management tools like Zephyr
• Excellent communication and stakeholder engagement skills
• Experience mentoring QA teams and improving QA maturity