Lead Data Engineer
Data Software Engineering
& 7 others
Argentina
We are looking for a remote Lead Data Engineer to join our team.
The candidate will be responsible for leading the design, development, and implementation of world-class data solutions and applications, ensuring their scalability and performance.
Responsibilities
- Lead the design, development, and implementation of world-class data solutions and applications, ensuring their scalability and performance
- Understand business requirements and translate them into innovative data engineering strategies
- Oversee end-to-end data pipeline development, from data ingestion to transformation and storage
- Provide best practices for data engineering, ensuring data quality, security, and compliance
- Provide continuous improvement of data engineering processes by adopting Agile methodologies and driving CI/CD practices
- Lead the team and monitor and mentor junior members of the team,
Requirements
- 5+ years of relevant work experience with Data Engineering
- 1+ years of relevant leadership experience
- Expertise in Python
- Strong knowledge of AWS, harnessing cloud resources to optimize data processing and storage.
- Expertise in Databricks,
- Proficiency in Apache Spark or Hive, enabling you to work with large-scale data processing and analysis.
- Knowledge of CI/CD practices
- Proficiency in SQL
- Experience with Terraform,
- Strong understanding of Agile methodologies
- B2+ English level
Nice to have
- Familiarity with Docker and Kubernetes
- Knowledge of streaming data processing technologies like Apache Kafka or Apache Flink
- Experience with data warehousing solutions like Amazon Redshift or Snowflake
- Understanding of machine learning concepts
Benefits
- International projects with top brands
- Work with global teams of highly skilled, diverse peers
- Healthcare benefits
- Employee financial programs
- Paid time off and sick leave
- Upskilling, reskilling and certification courses
- Unlimited access to the LinkedIn Learning library and 22,000+ courses
- Global career opportunities
- Volunteer and community involvement opportunities
- EPAM Employee Groups
- Award-winning culture recognized by Glassdoor, Newsweek and LinkedIn