Senior Data Engineer – Investment Data Platform

About the role

As a Senior Data Engineer you will join the Operations team of the Universities Superannuation Scheme Limited and help build the Investment Data Platform (IDP). You will work on a large‑scale pension data environment, delivering modern data solutions that support investment decision‑making.

Key responsibilities

• Design and implement a Fabric Data Lakehouse for the Investment Management business using a medallion architecture.
• Develop scalable, secure ETL/ELT pipelines on cloud platforms such as Microsoft Fabric, Databricks and Azure.
• Share knowledge with a small team of data engineers and promote best‑practice engineering standards.
• Collaborate with architects, security, and business stakeholders to translate requirements into robust data solutions.
• Ensure compliance with data security and privacy policies through secure‑by‑design practices.
• Provide technical support, troubleshoot production issues, and document solutions.

Required profile

• Significant hands‑on experience delivering scalable data platforms on cloud technologies.
• Proven ability to work in an agile environment and partner with cross‑functional teams.
• Strong analytical mindset with a focus on data quality and governance.

Required skills

• Python
• Spark
• SQL / NoSQL
• PowerShell
• Azure Data Factory
• Azure DevOps
• Microsoft Fabric
• Databricks
• Snowflake