Back to SearchMexico
We are seeking a skilled Senior Data DevOps Engineer to ensure the reliability, scalability, and optimization of our client's data infrastructure.
This role plays a key role in leveraging advanced technologies and fostering team collaboration to create resilient solutions in a fast-paced, data-focused setting.
Responsibilities
- Optimize workflows in Apache Airflow/MWAA, Spark, and Flink to enhance data processing capabilities
- Deploy cloud-native infrastructure by leveraging AWS, Kubernetes, and Terraform
- Coordinate with stakeholders to define technical requirements and update infrastructure plans
- Maintain and troubleshoot Datadog data infrastructure to ensure seamless availability and performance
- Enhance CI/CD pipelines using tools like Spinnaker and Jenkins to ensure consistent application delivery
Requirements
- Background in Amazon Web Services, Kubernetes, or Terraform with a minimum of 3 years' experience in cloud-native technologies
- Competency in managing and improving workflows within Apache Airflow, Spark, or Flink
- Expertise in automating and refining CI/CD pipelines using tools such as Spinnaker and Jenkins
- Knowledge of performance monitoring and resolution of infrastructure issues utilizing Datadog
- Understanding of effective collaboration for requirement gathering and developing infrastructure solutions
Nice to have
- Skills in working with Apache Flink or Apache NiFi for advanced data workflows
- Familiarity with Databricks for managing data engineering and analytics tasks
- Proficiency in leveraging Datadog’s advanced capabilities for detailed system monitoring
Benefits
- International projects with top brands
- Work with global teams of highly skilled, diverse peers
- Healthcare benefits
- Employee financial programs
- Paid time off and sick leave
- Upskilling, reskilling and certification courses
- Unlimited access to the LinkedIn Learning library and 22,000+ courses
- Global career opportunities
- Volunteer and community involvement opportunities
- EPAM Employee Groups
- Award-winning culture recognized by Glassdoor, Newsweek and LinkedIn