Senior Data Engineer

About the role

We are looking for an experienced Senior Data Engineer to join a leading international financial institution on a contract basis. The role focuses on designing, building and optimising modern data platforms using Python, Databricks and Spark to enable advanced analytics and data‑driven innovation across the business.

Key responsibilities

• Design, develop and maintain scalable data pipelines with Python and Databricks.
• Build and optimise ETL/ELT processes leveraging Spark, PySpark and Delta Lake.
• Create robust data models and lakehouse architectures for large‑scale analytics.
• Implement and manage data workflows, monitoring, logging and alerting across the Databricks ecosystem.
• Ensure data quality, governance, reliability and performance at scale.
• Collaborate with data scientists, analysts and business stakeholders to support analytics and machine‑learning initiatives.
• Mentor junior team members and champion engineering best practices.

Required profile

• 10+ years of data engineering experience, preferably in banking, financial services or other highly regulated environments.
• Strong hands‑on expertise in Python and Apache Spark/PySpark.
• Proven experience with Databricks, notebooks, jobs and Delta Lake.
• Advanced SQL skills and experience with relational databases.
• Experience working with cloud platforms such as AWS, Azure or GCP.

Required skills

• Python
• Databricks
• Apache Spark / PySpark
• Delta Lake
• SQL
• Relational databases
• ETL/ELT design
• Lakehouse architecture
• Data modelling
• AWS
• Azure
• Google Cloud Platform
• Snowflake
• Amazon Redshift
• Google BigQuery