Senior Databricks / Snowflake Data Architect
statestreet · London
Job description
About the role
State Street's BestX engineering team is looking for an experienced Senior Databricks / Snowflake Data Architect to lead the design and evolution of its next-generation cloud-native data platform. The platform supports multi-asset Transaction Cost Analysis (TCA), analytics and reporting, and the role combines strong data architecture expertise with a hands-on engineering mindset and a passion for evaluating emerging technologies.
Key responsibilities
- Design and develop the architecture for the multi-asset TCA and analytics platform
- Lead technology evaluations, proof-of-concepts and rapid prototyping
- Architect scalable data lakehouse solutions with Databricks, Snowflake and cloud-native services
- Design high-performance data models, ingestion frameworks and transformation pipelines for real-time and batch workloads
- Establish best practices for data governance, lineage, security, metadata management and observability
- Build and optimise analytical platforms for large-scale market, transaction and reference datasets
- Work with quantitative researchers, product and engineering teams to turn business needs into scalable solutions
- Define architectural standards and roadmaps for data warehousing, lakehouse, streaming and AI/ML workloads
- Drive adoption of Agile, DevOps, CI/CD, Infrastructure-as-Code and DataOps practices
- Mentor engineering teams, own architecture decisions and understand TCA, best execution workflows and regulatory requirements such as MiFID II and MiFIR
Required profile
- Enterprise-scale data platform design and implementation experience
- Hands-on Databricks (Delta Lake, Unity Catalog, Spark, Structured Streaming, Lakehouse) and Snowflake (data modelling, performance tuning, Snowpark, data sharing, governance)
- Ability to quickly evaluate, prototype and compare emerging technologies
- Understanding of dimensional modelling, Data Vault, lakehouse methodologies and distributed computing
- Cloud experience, preferably AWS (S3, EMR, Glue, ECS/EKS, Lambda); streaming with Kafka, Spark Streaming or Event Bridge
- Strong software engineering and DevOps mindset, stakeholder management and communication skills
- Preferred: capital markets analytics platforms, TCA knowledge, AI/ML platforms, data catalogues, BI tools, cloud migration experience and regulated financial services background
Questions fréquentes
Why are you reporting this job?
Explore further
Salaries, guides and searches in the United Kingdom.
Salaries by job title
Apply in 30 seconds
Enter your email to apply. An account will be created automatically.
By continuing, you accept our terms of use.
Already have an account? Login
A question about this job?
Ask it here: you will get the full job summary by e-mail, right away.
Published 2 hours ago
Expires 1 month from now
3 views · 0 interested
Boost your chances
Upload your CV — we will match you with relevant openings.
Analyzing your CV...
statestreet
London
Related job offers
-
Senior Data Engineer – Infrastructure Data & Analytics
Global University Systems (GUS) London -
Business Systems Manager – Responsable de la plateforme IFS Cloud (Hill Group UK)
Hill Group UK London -
Transformation Portfolio Manager (12 mois) – Affinity Water
Affinity Water London -
AI Application Support Analyst
Gallagher Colombo -
Software Engineer – Embedded Systems & Firmware
Onodrim Industries Vilnius