Data Engineer

About the role

We are looking for a Data Engineer to join Compare the Market’s technology team in London. You will design, build and operate scalable data pipelines and platform components that enable millions of customers to make informed financial decisions.

Key responsibilities

• Design, develop and maintain reliable data pipelines, services and platform components.
• Deliver end‑to‑end data engineering solutions from design through deployment and production support.
• Contribute to technical decision‑making, balancing quality, performance, reliability and sustainability.
• Monitor, optimise and ensure operability of data services in production environments.
• Identify and resolve data quality issues, technical debt and performance bottlenecks.
• Promote engineering best practices across testing, CI/CD, observability and secure development.
• Collaborate with engineering, analytics and data teams to provide scalable data solutions.
• Participate in incident response, root‑cause analysis and continuous improvement initiatives.

Required profile

• Proven experience delivering data pipelines or platform components in modern production environments.
• Comfortable owning services end‑to‑end with solid understanding of data engineering principles, data modelling and scalable system design.
• Experience with modern data platforms and processing patterns.
• Strong programming skills in Python and SQL.
• Familiarity with cloud‑based environments and CI/CD practices.
• Ability to make sound technical decisions and communicate trade‑offs clearly.
• Strong problem‑solving and collaboration skills in a fast‑paced engineering setting.

Required skills

• Python
• SQL