Back to SearchMexico
We are seeking a skilled Data DevOps Engineer to ensure the reliability, scalability, and optimization of our client's data infrastructure.
This role is pivotal in managing cutting-edge technologies and collaborating across teams to deliver robust solutions in a dynamic, data-driven environment.
Responsibilities
- Manage and optimize workflows in Apache Airflow/MWAA, Spark, and Flink for efficient data processing
- Deploy and maintain cloud-native infrastructure with AWS, Kubernetes, and Terraform
- Collaborate with stakeholders to gather technical requirements and provide infrastructure updates
- Upgrade and troubleshoot Datadog data infrastructure to maintain high availability and performance
- Improve and streamline CI/CD pipelines using tools like Spinnaker and Jenkins for consistent application deployment
Requirements
- Background in Amazon Web Services, Kubernetes, or Terraform with at least 2 years of experience in cloud-native technologies
- Competency in managing workflows in Apache Airflow, Spark, or Flink
- Expertise in developing, optimizing, and automating CI/CD pipelines using tools like Spinnaker and Jenkins
- Knowledge of performance monitoring and troubleshooting within infrastructures, particularly with Datadog
- Understanding of stakeholder collaboration processes for gathering requirements and implementing infrastructure solutions
Nice to have
- Skills in Apache Flink or Apache NiFi for data processing workflows
- Familiarity with Databricks for advanced data engineering and analytics tasks
- Expertise in using Datadog’s advanced features for in-depth monitoring of data systems
Benefits
- International projects with top brands
- Work with global teams of highly skilled, diverse peers
- Healthcare benefits
- Employee financial programs
- Paid time off and sick leave
- Upskilling, reskilling and certification courses
- Unlimited access to the LinkedIn Learning library and 22,000+ courses
- Global career opportunities
- Volunteer and community involvement opportunities
- EPAM Employee Groups
- Award-winning culture recognized by Glassdoor, Newsweek and LinkedIn