Mexico
Join our team as a Lead Data DevOps Engineer, where you will play a vital role in ensuring the reliability and scalability of our data infrastructure.
Your expertise will focus on system optimization, troubleshooting, CI/CD pipeline enhancements, and collaboration with stakeholders to deliver impactful solutions in a data-centric environment. We welcome your application to support our mission.
Responsibilities
- Ensure workflows in Airflow, Spark, and Flink are optimized for effective data processing
- Maintain and deploy cloud-native infrastructure using AWS and Kubernetes
- Provide infrastructure updates based on stakeholder requirements
- Upgrade data infrastructure to ensure high availability and seamless performance
- Enhance application deployment processes by optimizing CI/CD pipelines
- Apply Terraform to implement infrastructure as code solutions
- Improve system performance and reliability using Datadog
Requirements
- 5+ years of experience in Data DevOps
- Leadership experience of 1+ years
- Proficiency in Amazon Web Services
- Expertise in Apache Airflow
- Understanding of Kubernetes
- Knowledge of Terraform
- Familiarity with CI/CD practices
- Upper-Intermediate English proficiency
Nice to have
- Proficiency in Apache Flink
- Understanding of Apache NiFi
- Background in Databricks and Datadog
Benefits
- International projects with top brands
- Work with global teams of highly skilled, diverse peers
- Healthcare benefits
- Employee financial programs
- Paid time off and sick leave
- Upskilling, reskilling and certification courses
- Unlimited access to the LinkedIn Learning library and 22,000+ courses
- Global career opportunities
- Volunteer and community involvement opportunities
- EPAM Employee Groups
- Award-winning culture recognized by Glassdoor, Newsweek and LinkedIn