Back to SearchChief Software Engineer - MCP Server
Remote in Mexico
AI Solution Engineering& 10 others
Looking for something else?
Find a vacancy that works for you. Send us your CV to receive a personalized offer.
Find me a job
We are seeking a Chief Software Engineer to lead a secure, scalable AI Gateway for governed LLM and agentic workflows in multi-tenant SAAS. You will shape MCP server frameworks, routing, governance, observability, and Kubernetes delivery while partnering across product teams.
Responsibilities
- Build the AI Gateway platform across MCP, agents, LLM routing, governance, and observability
- Translate business and product requirements into crisp problem statements, architecture designs, and scalable technical solutions
- Design extensible frameworks for MCP server capabilities and integrations, along with agent orchestration and reusable agent skills
- Architect gateway features including semantic caching for LLM responses, rate limiting, quotas, traffic governance, and guardrails and validation layers for safe LLM/MCP usage
- Define and review authentication and authorization models, including multiple OIDC-based flows, identity propagation, and token-based access control for MCP and LLM traffic
- Create prototypes and reference implementations to validate architectural choices and guide engineering teams
- Collaborate with multiple product teams integrating with the AI Gateway by providing architecture guidance, best practices, and integration patterns
- Review designs and code to deliver actionable feedback that improves quality, performance, scalability, and security
- Define and review CI/CD best practices using modern GitHub-based pipelines
- Architect and review Kubernetes-based deployment models to ensure scalability, resiliency, and production readiness
Requirements
- Proven track record with 7+ years of software engineering experience, including significant responsibility in a principal engineer role
- Demonstrated experience designing and shipping large-scale distributed systems or platform products
- High proficiency in Golang and Python for production-grade services
- Hands-on familiarity with AI centric development, emphasizing quality gates and architecture patterns that enforce agentic behavior for producing quality code
- Deep understanding of AI gateways, AI/LLM platforms, or middleware systems, including routing, governance, and scalability
- Solid background with microservices and service-oriented architectures for multi-tenant SAAS environments
- Practical skills using PostgreSQL for transactional data and Redis for caching and distributed coordination
- Strong expertise in authentication and authorization systems, especially OAuth-based approaches
- Proven ability to independently drive problem definition, architecture, prototype, and execution guidance
- Experience designing platforms and frameworks consumed by multiple product teams
Nice to have
- Experience with MCP (Model Context Protocol), agentic platforms, or AI orchestration frameworks
- Knowledge of working with EDA software
- Prior work on LLM gateways, API gateways, or AI middleware platforms
- Experience building generic developer frameworks or SDKs adopted across teams
- Familiarity with guardrails, semantic caching, prompt/response optimization, and LLM cost control techniques
- Experience operating high-throughput, low-latency systems in Kubernetes environments
- Strong written and verbal communication skills for cross-team architectural alignment