Jobiglo

No results.

Principal Data Engineer - AWS

Capco · UK - London

New
Hybrid Senior 🇬🇧 English
AWS Python Scala Java Spark Hadoop Kafka Kinesis CI/CD DevOps Data Lakehouse GDPR

Job description

About the role

Capco is looking for a Principal Data Engineer with AWS to join its growing team of engineering experts supporting Tier 1 financial services clients. The role is based in London on a hybrid basis and is permanent. You will design, build and deploy cloud-based data pipelines that power scalable, trusted data platforms, working across greenfield initiatives and enterprise-scale programmes. You will also use approved AI and automation tools where appropriate, with sound engineering judgement and responsible AI practices.

Key responsibilities

  • Design and build end-to-end data pipelines using AWS-native services and modern cloud data architectures, ensuring scalable, secure and resilient solutions.
  • Partner with clients and cross-functional teams to understand business requirements, define technical solutions and deliver production-grade data platforms.
  • Apply AWS Well-Architected Principles, engineering best practices, CI/CD and AI-enabled development approaches to improve quality, efficiency and operational excellence.
  • Lead the development of robust, tested, fault-tolerant data engineering solutions and promote responsible engineering standards and governance.
  • Mentor engineers, share technical expertise and encourage the effective and responsible use of approved AI tools and automation.

Required profile

  • Strong proficiency in Python, Scala or Java, with hands-on experience of Big Data technologies such as Spark, Hadoop or similar distributed processing frameworks.
  • Experience building real-time event streaming solutions with Kafka, Spark Streaming or Amazon Kinesis in AWS environments.
  • Proven expertise in modern data architectures including Data Lakehouse and Data Warehousing, alongside CI/CD, DevOps practices and data governance including GDPR.
  • A collaborative engineering mindset, excellent stakeholder communication skills, and the ability to turn business requirements into practical technical solutions.

Bonus points

  • Data modelling, schema design and structured and semi-structured datasets.
  • Distributed technologies such as Hadoop, Spark, HDFS, Hive, Databricks or AWS Lake Formation.
  • Automating ingestion and transformation frameworks in cloud-native data platforms.
  • Experience in highly regulated industries such as financial services.

What we offer

  • Discretionary bonus, competitive pension, health, life and critical illness insurance.
  • Mental health support and family-friendly leave, including maternity, adoption, shared parental and bereavement leave.
  • Eight complimentary backup care sessions, five weeks of annual leave and online GP services.
  • Minimum 40 hours of training per year, a Business Coach from day one and certifications.
  • Wellhub (Gympass), travel insurance, Tastecard, season ticket loans, Cycle to Work and dental insurance.

Questions fréquentes

Le salaire n'est pas communiqué publiquement par le recruteur. Vous pouvez postuler et négocier directement avec Capco.
Cliquez sur "Postuler maintenant" en haut de la page. Vous pouvez importer votre CV en 1 clic — Jobiglo extrait automatiquement vos informations et postule pour vous.
Source : ats:greenhouse

Why are you reporting this job?

Thank you for your report. We will review this job.

Explore further

Salaries, guides and searches in the United Kingdom.

Apply in 30 seconds

Enter your email to apply. An account will be created automatically.

Apply now →

By continuing, you accept our terms of use.

Already have an account? Login

A question about this job?

Ask it here: you will get the full job summary by e-mail, right away.

Published 3 days ago

Expires 1 month from now

11 views · 0 interested

Boost your chances

Upload your CV — we will match you with relevant openings.

Analyzing your CV...

Capco

UK - London