Principal Data Engineer – Contract (Databricks)

About the role

We are seeking an experienced Principal Data Engineer on a contract basis to support complex client engagements in Data & AI transformation programmes. This client‑facing consultancy role blends strategic advisory with hands‑on technical delivery, working directly with senior stakeholders and delivery teams.

Key responsibilities

• Act as a trusted technical advisor, building relationships with senior client stakeholders and translating technical concepts into business value.
• Lead the design and implementation of enterprise‑scale Databricks solutions and modern cloud‑native data platforms.
• Drive technical delivery across multiple engagements, ensuring high‑quality, scalable engineering outcomes.
• Mentor engineering teams, lead problem‑solving, and promote DevOps and automation best practices.

Required profile

• Proven experience as a Principal Data Engineer, Lead Data Engineer or Data Architect in enterprise environments.
• Strong consultancy and client‑facing experience across multiple engagements.
• Deep expertise in Databricks architecture, optimisation and team leadership.
• Experience designing cloud‑native data platforms on Azure and/or AWS.
• Advanced skills with PySpark, SparkSQL and large‑scale distributed processing.
• Solid understanding of modern data architecture, ETL/ELT frameworks, data modelling and governance.
• Excellent SQL proficiency and experience with large datasets.
• Strong communication, stakeholder management and consulting abilities.

Required skills

• Databricks
• Azure
• AWS
• PySpark
• SparkSQL
• SQL

What we offer

• Opportunity to work on high‑impact client programmes and enterprise‑scale Data & AI transformations.
• Flexible remote‑first working model aligned to client requirements.
• Access to AWS and Databricks partner training and certifications.
• Collaborative culture focused on technical excellence and innovation.
• Chance to influence engineering standards and delivery capability across Colibri Digital.