Back to SearchLead Azure DevOps Engineer
Hybrid in Armenia, & 4 others
DevOps& 6 others
Looking for something else?
Find a vacancy that works for you. Send us your CV to receive a personalized offer.
Find me a job
Choose an option
We are seeking a Lead Azure DevOps Engineer to drive the deployment, integration, and operation of AI/LLM gateway technologies within enterprise environments, ensuring secure, scalable, and resilient production systems.
Responsibilities
- Deploy and manage AI/LLM gateway technologies such as LiteLLM, Citadel, or Azure APIM AI Gateway
- Integrate models and providers into gateway solutions to support enterprise-scale operations
- Configure routing, policy enforcement, and token/rate controls across gateway infrastructure
- Establish observability and resilience mechanisms to maintain production stability
- Implement LLM routing and broker logic to optimize model performance and reliability
- Enforce enterprise policies, including PII detection and redaction, to ensure compliance and security
- Take ownership of gateway implementation projects and deliver functional solutions rapidly
- Collaborate with cross-functional teams to align gateway operations with organizational security standards
- Monitor and troubleshoot production systems to ensure continuous availability
Requirements
- 5+ years of hands-on engineering experience with AI/LLM gateway technologies, including deployment, integration, and production operations
- Expertise in Azure API Management, Azure DevOps, and Azure AI Content Safety
- Proficiency in LiteLLM and other LLM gateway platforms
- Knowledge of LLM security, PII detection and redaction, and enterprise policy enforcement
- Understanding of LLM routing, broker logic, and token/rate control mechanisms
- Skills in observability, resilience engineering, and production system operations
- Capability to take ownership and deliver functional gateway implementations rapidly
- English proficiency at B2 level or higher