Back to Search
We are seeking a talented remote Lead Data Software Engineer to join our team and support our Data Science teams.
As a Lead Data Software Engineer, you will play a key role in the development and maintenance of datamarts, ensuring efficient and scalable data solutions for our clients.
Your main focus will be on building and maintaining data pipelines, providing on-call support, and working collaboratively with Data Science teams to deliver high-quality solutions. You will also be responsible for leading a group of talented professionals, providing mentorship and guidance to enable them to deliver industry-leading solutions.
Responsibilities
- Lead and mentor the Data Software Engineering team, fostering a culture of growth and continuous learning within the group
- Collaborate with cross-functional teams to deliver high-quality data solutions in line with project goals and timelines
- Develop and maintain effective Data Software Engineering processes and practices that focus on automation, innovation, and efficiency
- Ensure the implementation and maintenance of efficient and scalable data solutions using AWS services
- Oversee the optimization of data processing and workflow management using Apache Airflow and Apache Spark
- Continuously evaluate industry trends and best practices to refine and implement the most effective Data Software Engineering strategies
- Provide on-call support for data pipelines and datamarts
- Guide the team in the development and deployment of REST APIs for data integration and communication
- Work directly with clients to understand their needs and deliver effective, tailored solutions
- Drive the team's organization and structure, ensuring the efficient and timely delivery of projects
- Collaborate with stakeholders, demonstrating excellent communication and leadership skills
Requirements
- Minimum of 5 years of experience as a Data Software Engineer, working with large-scale projects and complex data infrastructures
- At least 1 years of proven leadership experience, successfully managing and inspiring a team of Data Software Engineers
- Expertise in Amazon Web Services, designing and implementing scalable and efficient data solutions
- Solid experience in Apache Airflow and Apache Spark, ensuring efficient data processing and workflow management
- Advanced experience with at least one CI/CD tool, preferably Jenkins, for efficient delivery of data pipelines
- Proficiency in Python and SQL, developing and maintaining data pipelines and ETL processes
- Experience with Databricks and PySpark for data processing and analysis
- Knowledge of REST APIs for data integration and communication
- Strong analytical skills, enabling effective problem-solving and decision-making in complex environments
- Strong client-facing skills, enabling effective communication and collaboration to meet project objectives
- Excellent organizational and structuring abilities, promoting the efficient delivery of projects
- Upper-intermediate English language proficiency level, enabling clear collaboration, presentation, and discussion with the team and stakeholders
Nice to have
- Experience with Redshift for data warehousing and analysis
Benefits
- International projects with top brands
- Work with global teams of highly skilled, diverse peers
- Healthcare benefits
- Employee financial programs
- Paid time off and sick leave
- Upskilling, reskilling and certification courses
- Unlimited access to the LinkedIn Learning library and 22,000+ courses
- Global career opportunities
- Volunteer and community involvement opportunities
- EPAM Employee Groups
- Award-winning culture recognized by Glassdoor, Newsweek and LinkedIn