AI Backend Engineer

About the role

ITV is looking for an AI Backend Engineer to join its Group Data team within the AI Agent Hub delivery group. You will help build, extend and improve backend services, APIs and AI platform capabilities that power ITV’s internal AI platform.

Key responsibilities

• Design, develop and maintain backend services for the AI Agent Hub using Python, FastAPI and Open WebUI patterns.
• Create and evolve OpenAI‑compatible APIs, LiteLLM integrations and RAG pipelines for knowledge ingestion and model routing.
• Implement secure internal system integrations, evaluation workflows, usage analytics and audit logging.
• Collaborate with frontend, platform, product, design, architecture, cyber security and data teams to deliver reliable, observable and governed AI services.
• Translate emerging AI capabilities into production‑ready services that are easy for internal teams to adopt.

Required profile

• Proven experience building backend services and APIs in a production environment.
• Strong understanding of AI/LLM concepts, retrieval‑augmented generation and model routing.
• Ability to work cross‑functionally with security, data and product stakeholders.
• Focus on delivering secure, maintainable and observable solutions.

Required skills

• Python
• FastAPI
• Open WebUI
• LiteLLM integration
• RAG pipelines
• Knowledge ingestion
• Model routing
• Secure system integration
• Evaluation workflows
• API development
• Integration services
• LLM routing
• Tool calling
• Access control
• Usage analytics
• Audit logging