Principal Data Engineer - AWS
Capco · UK - London
Job description
About the role
Capco is looking for a Principal Data Engineer with AWS to join its growing team of engineering experts supporting Tier 1 financial services clients. The role is based in London on a hybrid basis and is permanent. You will design, build and deploy cloud-based data pipelines that power scalable, trusted data platforms, working across greenfield initiatives and enterprise-scale programmes. You will also use approved AI and automation tools where appropriate, with sound engineering judgement and responsible AI practices.
Key responsibilities
- Design and build end-to-end data pipelines using AWS-native services and modern cloud data architectures, ensuring scalable, secure and resilient solutions.
- Partner with clients and cross-functional teams to understand business requirements, define technical solutions and deliver production-grade data platforms.
- Apply AWS Well-Architected Principles, engineering best practices, CI/CD and AI-enabled development approaches to improve quality, efficiency and operational excellence.
- Lead the development of robust, tested, fault-tolerant data engineering solutions and promote responsible engineering standards and governance.
- Mentor engineers, share technical expertise and encourage the effective and responsible use of approved AI tools and automation.
Required profile
- Strong proficiency in Python, Scala or Java, with hands-on experience of Big Data technologies such as Spark, Hadoop or similar distributed processing frameworks.
- Experience building real-time event streaming solutions with Kafka, Spark Streaming or Amazon Kinesis in AWS environments.
- Proven expertise in modern data architectures including Data Lakehouse and Data Warehousing, alongside CI/CD, DevOps practices and data governance including GDPR.
- A collaborative engineering mindset, excellent stakeholder communication skills, and the ability to turn business requirements into practical technical solutions.
Bonus points
- Data modelling, schema design and structured and semi-structured datasets.
- Distributed technologies such as Hadoop, Spark, HDFS, Hive, Databricks or AWS Lake Formation.
- Automating ingestion and transformation frameworks in cloud-native data platforms.
- Experience in highly regulated industries such as financial services.
What we offer
- Discretionary bonus, competitive pension, health, life and critical illness insurance.
- Mental health support and family-friendly leave, including maternity, adoption, shared parental and bereavement leave.
- Eight complimentary backup care sessions, five weeks of annual leave and online GP services.
- Minimum 40 hours of training per year, a Business Coach from day one and certifications.
- Wellhub (Gympass), travel insurance, Tastecard, season ticket loans, Cycle to Work and dental insurance.
Questions fréquentes
Why are you reporting this job?
Explore further
Salaries, guides and searches in the United Kingdom.
Salaries by job title
Apply in 30 seconds
Enter your email to apply. An account will be created automatically.
By continuing, you accept our terms of use.
Already have an account? Login
A question about this job?
Ask it here: you will get the full job summary by e-mail, right away.
Published 3 days ago
Expires 1 month from now
10 views · 0 interested
Boost your chances
Upload your CV — we will match you with relevant openings.
Analyzing your CV...
Capco
UK - London