Senior Databricks QA Engineer

About the role

We are seeking a Senior QA Automation Engineer to support a leading client’s data platform in Swindon. The role is hybrid, with at least one day per week on‑site, and runs for six months under an IR35‑inside contract.

Key responsibilities

• Design, develop and maintain automated test frameworks for data pipelines and ETL processes.
• Validate large‑scale data generation, transformation, joins and quality across Databricks and AWS Glue environments.
• Collaborate with data engineers to create robust test data sets and ensure end‑to‑end coverage.
• Report defects, track test results and contribute to continuous improvement of testing practices.

Required profile

• Proven experience testing data pipelines and ETL workflows.
• Hands‑on expertise with Apache Spark and Databricks or AWS Glue.
• Strong ability to build automation frameworks, preferably using Python.
• Solid understanding of data transformations, joins and data‑quality principles.
• Familiarity with cloud platforms, especially AWS.

Required skills

• Apache Spark
• Databricks
• AWS Glue
• Python
• ETL processes
• AWS

What we offer

• 6‑month fixed‑term contract, hybrid working.
• Daily rate of £400‑£500 (inside IR35).
• Flexibility to start within two weeks of offer.