Senior AI Data Engineer – LLM & Market Data (Front Office)

About the role

A Tier 1 financial institution is looking for a Senior AI Data Engineer to join a strategic front‑office data and technology function. You will help design and build scalable data platforms that support trading, market data and critical business workflows across multiple asset classes.

Key responsibilities

• Design, develop and maintain Python‑based data engineering solutions for enterprise platforms.
• Build scalable ETL and data ingestion pipelines handling large volumes of market, reference and business data.
• Develop data transformation, validation, reconciliation and quality‑control frameworks.
• Engineer APIs, automation tools and workflow orchestration to improve data distribution and operational processes.
• Partner with business, operations and technology stakeholders to capture data requirements and deliver solutions.
• Contribute to cloud‑native data platform initiatives on AWS, Azure and related technologies.
• Support onboarding of new data sources and vendor feeds into strategic platforms.
• Enhance observability, monitoring, lineage and operational controls across data workflows.
• Participate in architecture discussions and shape future‑state data platform capabilities.

Required profile

• Strong Python and data‑engineering expertise with a practical understanding of enterprise data platforms in large financial institutions.
• Proven experience solving complex data challenges and delivering scalable solutions for critical business functions.
• Ability to work across multiple stakeholder groups and communicate technical concepts effectively.
• Track record of contributing to high‑visibility, strategic programmes with long‑term impact.

Required skills

• Python
• ETL/ELT pipeline development
• Data transformation, validation and reconciliation
• Data quality frameworks
• Handling large and complex datasets
• AWS
• Azure
• API development
• Automation tooling
• Workflow orchestration
• Observability and monitoring
• Data lineage
• Cloud‑native infrastructure