Lead Data Platform Engineer
carnallfarrar · London
Job description
About the role
Carnall Farrar, a consultancy serving the healthcare sector, is hiring a Lead Data Platform Engineer in its Data Innovation department in London. The role is the senior technical lead for the data platform, combining design authority over platform architecture, mentoring and directing the data engineering team and managing delivery of platform and data engineering workstreams. It sits within the unified Data Innovation and Data Ops function, alongside the Lead Data Scientist(s), and offers a hybrid workplace.
Key responsibilities
- Produce detailed technical designs for cloud infrastructure (OCI, Databricks) and NHS data pipelines, and define integration patterns, data flows and component specifications
- Make implementation-level technology decisions and design scalable, secure architectures compliant with NHS IG, ISO 27001 and GDPR
- Own day-to-day delivery of platform and data engineering workstreams, including workplans, capacity management, QA coordination and risk escalation
- Maintain engineering standards, design patterns and reference architectures, and conduct architectural reviews
- Contribute technical expertise to vendor partnerships (e.g. Databricks), proposals and client-facing materials
- Mentor data engineers, set objectives, run technical training and help define the technical career path
Required profile
- Around 4 years of experience in data or platform engineering, preferably with senior or lead responsibility for a production data platform
- Experience mentoring or managing engineers, and owning delivery of technical workstreams
- Experience designing to regulated data requirements such as NHS IG, ISO 27001 and GDPR
- Clear communicator and confident in commercial and partner-facing technical discussions
Required skills
- Databricks and OCI, or comparable platforms, with secure data architecture
- Python and SQL, and production pipelines with PySpark or Spark
- Infrastructure as code, CI/CD and Git/GitHub
- Desirable: Unity Catalog, Delta Lake, medallion architecture, dbt, dimensional modelling, multi-region design, and NHS patient-level data
What we offer
- 25 days holiday (30 for leadership), with additional leave purchase available
- Pension contributions of 7% from the employer, income protection and enhanced sick pay
- Flexible working: one day from home per week as standard, plus 44 remote working days per year
- Employee assistance programme, flu vaccinations, eye care vouchers and a ride-to-work scheme
Questions fréquentes
Why are you reporting this job?
Explore further
Salaries, guides and searches in the United Kingdom.
Salaries by job title
Apply in 30 seconds
Enter your email to apply. An account will be created automatically.
By continuing, you accept our terms of use.
Already have an account? Login
A question about this job?
Ask it here: you will get the full job summary by e-mail, right away.
Published 19 hours ago
Expires 1 month from now
12 views · 0 interested
Boost your chances
Upload your CV — we will match you with relevant openings.
Analyzing your CV...
carnallfarrar
London