Lead Data Engineer

About the role

We are looking for a Lead Data Engineer to drive large‑scale data initiatives for a leading international financial institution. The role blends hands‑on engineering with project delivery, team leadership and stakeholder engagement in a complex, global environment.

Key responsibilities

• Own end‑to‑end delivery of data engineering projects, meeting business objectives, timelines and quality standards.
• Design, develop and optimise scalable pipelines using Python, Databricks and PySpark.
• Build and enhance ETL/ELT workflows, reusable frameworks and modern Lakehouse solutions.
• Provide technical leadership, architectural guidance and governance for data platform initiatives.
• Manage sprint planning, backlog prioritisation and delivery tracking within Agile teams.
• Identify and mitigate delivery risks, dependencies and technical challenges.
• Champion engineering best practices, including CI/CD, DevOps, testing and code reviews.
• Mentor and develop a team of data engineers, fostering ownership and excellence.

Required profile

• Proven experience leading data engineering teams in a financial or enterprise setting.
• Strong project management skills with a track record of delivering complex data solutions.
• Excellent communication skills to translate business requirements into technical designs.

Required skills

• Python
• Databricks
• Apache Spark / PySpark
• Delta Lake and Lakehouse architecture
• ETL / ELT workflow design
• CI/CD pipelines
• DevOps and automation
• Agile methodologies
• Monitoring, logging and alerting