Data Engineer

About the role

We are seeking a Data Engineer to join a fast‑growing UK technology consultancy that supports public‑sector clients. You will design and deliver robust data pipelines that enable analytics, machine learning and business intelligence while ensuring security and compliance.

Key responsibilities

• Assess client technical needs and manage stakeholder relationships.
• Design, build and maintain ETL/ELT pipelines across on‑premise, cloud and hybrid environments.
• Harvest, ingest, cleanse, migrate and transform structured and unstructured data.
• Create and manage data structures, storage solutions and data flows for analytics and compliance.
• Implement security, scalability, reliability and portability best practices in all data handling.

Required profile

• 3+ years of industry experience in data engineering, preferably in a consultancy or client‑delivery setting.
• Hands‑on experience with Spark, Python, Kafka, SQL and Airflow.
• Proficiency with cloud platforms (AWS, Azure or GCP) and database technologies such as Postgres, Hadoop, Elasticsearch and graph databases.
• Experience designing schemas for data warehouses and data marts, and embedding data‑quality checks.
• Strong understanding of coding best practices, CI/CD, version control, monitoring and alerting.

Required skills

• Spark
• Python
• Kafka
• SQL
• Airflow
• AWS
• Azure
• GCP
• Postgres
• Hadoop
• Elasticsearch
• Graph databases
• CI/CD