Senior Data Engineer (Databricks)

About the role

We are looking for a Senior Data Engineer to shape a modern Databricks environment within a fast‑growing technology business. You will work in a cloud‑first setting, collaborating with data scientists, analysts and senior stakeholders to deliver high‑performing data products.

Key responsibilities

• Build and maintain scalable data pipelines in Databricks.
• Develop and optimise batch and streaming workflows.
• Design Lakehouse architectures and medallion data models.
• Implement data quality, monitoring and observability frameworks.
• Maintain security, governance and access‑control standards.
• Collaborate with data scientists, analysts and product teams.
• Drive engineering best practices through code reviews and standards.
• Identify platform optimisation and cloud cost‑reduction opportunities.
• Translate business requirements into scalable technical solutions.
• Contribute to tooling decisions, documentation and continuous improvement.

Required profile

• Proven experience as a Data Engineer in production environments.
• Strong hands‑on experience with Databricks, Apache Spark, Delta Lake, Python and SQL.
• Experience building and supporting scalable ETL/ELT pipelines.
• Solid understanding of distributed data processing and data modelling.
• Cloud platform experience across Azure, AWS or GCP.
• Experience implementing data quality frameworks and pipeline monitoring.
• Excellent communication and stakeholder engagement skills.

Required skills

• Databricks
• Apache Spark
• Delta Lake
• Python
• SQL
• Azure
• AWS
• GCP
• Terraform or Bicep
• dbt
• Kafka
• Event Hubs
• Unity Catalog
• Databricks Asset Bundles

What we offer

• Salary up to £85,000 per year.
• Hybrid working model.
• Modern Databricks and Azure technology stack.
• Exposure to large‑scale, enterprise‑level data platforms.
• Opportunity to influence architecture and engineering standards.
• Collaborative and supportive engineering culture.
• Ongoing learning and professional development.
• Strong career progression within a growing technology business.