Kafka Administrator – Streaming Platform Engineer

About the role

We are looking for an experienced Kafka Administrator / DevOps Engineer to join our Streaming Center of Excellence. You will be responsible for delivering, operating, and optimizing enterprise‑scale Kafka‑based streaming platforms that power real‑time data ingestion and event‑driven architectures across critical business workloads.

Key responsibilities

• Design, deploy, configure and manage enterprise Kafka clusters, including brokers, Connect, Schema Registry, Streams and ZooKeeper/KRaft.
• Administer topics, partitions, replication, retention policies, consumer groups and perform upgrades, migrations, scaling and failover activities.
• Monitor cluster health, troubleshoot consumer lag, ISR issues, leader election problems and performance bottlenecks.
• Implement security controls such as SSL/TLS, ACLs, authentication, authorization and encryption.
• Build and maintain CI/CD pipelines (Jenkins, GitHub Actions, Azure DevOps) and develop IaC solutions with Terraform and Ansible.
• Deploy and manage Kafka workloads on Kubernetes, create Helm charts, support ArgoCD GitOps, and handle ConfigMaps, Secrets and rolling upgrades.
• Support Kafka deployments on AWS, Azure and GCP, collaborating with cloud engineering teams to optimise infrastructure.
• Implement observability using Prometheus, Grafana, Dynatrace and Confluent Control Center, create dashboards, alerts and drive SRE best practices.

Required profile

• Strong hands‑on experience with Apache Kafka in production environments.
• Deep understanding of Kafka architecture (brokers, topics, partitions, replication, consumer groups, Connect, Schema Registry, Streams, ZooKeeper/KRaft).
• Proven experience in performance tuning, capacity planning and troubleshooting large‑scale streaming systems.
• Solid background in DevOps automation, CI/CD pipelines and Infrastructure‑as‑Code.
• Experience deploying stateful workloads on Kubernetes and using GitOps tools.
• Familiarity with cloud platforms (AWS, Azure, GCP) and cloud‑native deployment practices.

Required skills

• Apache Kafka
• Kubernetes
• Jenkins
• GitHub Actions
• Azure DevOps
• Terraform
• Ansible
• Helm
• ArgoCD
• Prometheus
• Grafana
• Dynatrace
• Confluent Control Center
• AWS
• Microsoft Azure
• Google Cloud Platform
• SSL/TLS
• ACLs
• ZooKeeper / KRaft
• Kafka Connect
• Schema Registry
• Kafka Streams