Back to Search
We are in search of a highly skilled Lead Data Software Engineer to join our team remotely, contributing valuable support to our Data Science teams.
As the Lead Data Software Engineer, you'll assume a pivotal role in crafting and sustaining datamarts, ensuring the delivery of effective and scalable data solutions tailored to our clients' needs.
Your primary focus involves constructing and managing data pipelines, delivering on-call assistance, and fostering collaborative efforts with Data Science teams to achieve top-notch solutions. Additionally, you'll lead a team of adept professionals, providing mentorship and direction to empower them in delivering cutting-edge solutions.
Responsibilities
- Lead and nurture the Data Software Engineering team, cultivating a culture of continuous learning and growth within the group
- Collaborate with diverse teams to produce top-tier data solutions aligned with project objectives and timelines
- Forge and sustain efficient Data Software Engineering processes and practices, emphasizing automation, innovation, and efficiency
- Ensure the establishment and upkeep of effective, scalable data solutions utilizing AWS services
- Supervise the enhancement of data processing and workflow management through Apache Airflow and Apache Spark
- Regularly assess industry trends and best practices, refining and implementing optimal Data Software Engineering strategies
- Offer on-call support for data pipelines and datamarts
- Direct the team in developing and deploying REST APIs for seamless data integration and communication
- Engage directly with clients to comprehend their requirements and deliver tailored, effective solutions
- Manage the organization and structure of the team, guaranteeing the prompt and efficient delivery of projects
- Collaborate with stakeholders, showcasing exceptional communication and leadership skills
Requirements
- A minimum of 5 years' experience as a Data Software Engineer, having worked on large-scale projects with intricate data infrastructures
- At least 1 year of demonstrable leadership experience, effectively managing and motivating a team of Data Software Engineers
- Expertise in Amazon Web Services, including designing and implementing scalable, efficient data solutions
- Robust experience in Apache Airflow and Apache Spark, ensuring streamlined data processing and workflow management
- Advanced proficiency with at least one CI/CD tool, preferably Jenkins, for the efficient delivery of data pipelines
- Fluency in Python and SQL, involved in developing and maintaining data pipelines and ETL processes
- Familiarity with Databricks and PySpark for data processing and analysis
- Knowledge of REST APIs for seamless data integration and communication
- Strong analytical skills for effective problem-solving and decision-making in complex environments
- Exceptional client-facing skills, promoting clear communication and collaboration to meet project objectives
- Outstanding organizational and structuring abilities, facilitating the efficient delivery of projects
- Upper-intermediate proficiency in the English language, enabling clear collaboration, presentation, and discussion with the team and stakeholders
Nice to have
- Hands-on experience with Redshift for data warehousing and analysis
Benefits
- International projects with top brands
- Work with global teams of highly skilled, diverse peers
- Healthcare benefits
- Employee financial programs
- Paid time off and sick leave
- Upskilling, reskilling and certification courses
- Unlimited access to the LinkedIn Learning library and 22,000+ courses
- Global career opportunities
- Volunteer and community involvement opportunities
- EPAM Employee Groups
- Award-winning culture recognized by Glassdoor, Newsweek and LinkedIn