Data Engineer – Databricks

About the role

M&G is building a new solution to validate and transform policyholder data for actuarial modelling. This fixed‑term Data Engineer role will lead the design and implementation of scalable data pipelines using Databricks, and will transition the solution to the Business‑as‑Usual team.

Key responsibilities

• Lead the design and build of scalable data pipelines and architecture to support actuarial modelling needs.
• Ensure pipelines can be continually adapted in a controlled manner to meet emerging business requirements.
• Implement robust data validation, monitoring and governance to maintain data quality, integrity and consistency.
• Collaborate with stakeholders to translate data requirements into efficient technical solutions.
• Optimise data systems and processes for performance, reliability and scalability.
• Provide technical expertise and guidance on data engineering approaches, tools and best practices.
• Support integration of multiple data sources to create cohesive, accessible, and trusted datasets.
• Contribute to continuous improvement of data platforms, frameworks and engineering standards.
• Lead other data engineers and analysts to ensure consistency and high standards across the team.

Required profile

• Operating at a Manager or Expert level in data engineering.
• Proven ability to lead and mentor data engineers and analysts.
• Strong understanding of data governance, validation and quality assurance practices.
• Experience delivering robust data solutions in a finance or insurance context.

Required skills

• Databricks