Skip To Main Content
epam-logo-black.svgepam-logo-black.svg
backBack to Search

Senior Data Software Engineer

Mexico, Colombia
Data Software Engineering, Python, Amazon Web Services, Apache Spark, Databricks, Apache Airflow

We are seeking a skilled Senior Data Software Engineer to join our remote team, working with a leading European online retailer of shoes, fashion, and beauty. In this role, you will be responsible for developing, monitoring, and operating the most critical curated data pipeline at our Client's website. This pipeline processes hundreds of millions of records to provide high-quality datasets for analytical and machine learning use-cases. You will leverage and improve a cloud-based tech stack that includes AWS, Databricks, Kubernetes, Spark, Airflow, Python.

Responsibilities
  • Develop, monitor, and operate the most critical curated data pipeline at the customer's website, ensuring high-quality datasets for analytical and machine learning use-cases
  • Consult with analysts, data scientists, and product managers to build and continuously improve the customer's platform
  • Contribute to the development of data engineering best practices and standards, ensuring high-quality data processing and storage
  • Collaborate with cross-functional teams to identify and solve complex data engineering challenges
Requirements
  • A minimum of 3 years of experience in Data Software Engineering, demonstrating your expertise in data management and software engineering
  • Expertise in Python, Apache Spark, Databricks, showcasing your proficiency in the latest data engineering technologies
  • Experience with Amazon Web Services (AWS), Kubernetes, and other cloud-based technologies, highlighting your understanding of cloud-based data processing and storage
  • Strong analytical and problem-solving skills, enabling you to identify and solve complex data engineering challenges
  • Fluent spoken and written English at an Upper-Intermediate level or higher
Nice to have
  • Experience with other programming languages and technologies, such as Scala, Java, or SQL
  • Experience with data governance and security best practices
Benefits
  • International projects with top brands
  • Work with global teams of highly skilled, diverse peers
  • Healthcare benefits
  • Employee financial programs
  • Paid time off and sick leave
  • Upskilling, reskilling and certification courses
  • Unlimited access to the LinkedIn Learning library and 22,000+ courses
  • Global career opportunities
  • Volunteer and community involvement opportunities
  • EPAM Employee Groups
  • Award-winning culture recognized by Glassdoor, Newsweek and LinkedIn