Back to SearchSenior Automation Tester in Python
Remote in Poland
Automated Testing in Python& 6 others
Looking for something else?
Find a vacancy that works for you. Send us your CV to receive a personalized offer.
Find me a job
We are looking for a Senior Automation Tester in Python to own functional, security and performance test suites for the agentic gateway within our Enterprise Agent Development Platform — a production-grade, cloud-native ecosystem that enables engineering teams to define, orchestrate, deploy, and observe AI agents at scale.
Responsibilities
- Validate agentic workflows, including agent tool discovery, tool invocation and multi-step agent workflows
- Test MCP protocol functionality, including tool list aggregation, tool call routing and streaming response handling
- Verify agent authorization mechanisms through unauthorized tool access attempts and policy enforcement validation
- Conduct agent performance testing, covering tool discovery latency, concurrent agent sessions and agent-to-agent latency
- Build Python test automation suites using pytest with async support, mock MCP servers and agent workflow simulation
- Validate agentic observability, including trace completeness, agent step logging and audit trail verification
Requirements
- 3+ years of QA engineering experience for AI/ML or agent systems
- Hands-on experience testing AI agent systems in a production agentic AI project, such as MCP protocol testing, agent authorization/policy-enforcement testing or multi-step agent workflow test automation
- Experience testing LLM agent workflows, including tool calling and multi-step reasoning
- Expertise in security testing for authorization and authentication
- Skills in performance benchmarking for cloud services
- English proficiency at B2 level or higher
Nice to have
- Experience in MCP protocol testing
- Familiarity with agent framework testing (LangChain, LangGraph, Crew)
- Experience testing AWS Bedrock Agents
- Background in chaos engineering for agentic systems
- Skills in audit log validation (CloudTrail, OpenTelemetry traces)