Back to SearchLead Data Software Engineer
Data Software Engineering
& 6 others
Choose an option
We are looking for a seasoned Lead Data Software Engineer for a remote position to contribute to the success of our team and enhance our Data Science initiatives.
In this position, you will play a key role in developing and managing datamarts while delivering scalable and efficient data solutions tailored to client requirements. Your responsibilities will include building and maintaining data pipelines, providing on-call support, and collaborating with Data Science teams to ensure high-quality outcomes. Additionally, you will lead a team of talented professionals, offering mentorship and guidance to foster innovation and industry-leading solutions.
Responsibilities
- Provide leadership and mentorship to the Data Software Engineering team, cultivating an environment of growth and continuous learning
- Collaborate with cross-functional teams to deliver top-tier data solutions that align with project timelines and objectives
- Develop and implement effective Data Software Engineering practices, prioritizing automation, innovation, and efficiency
- Design and maintain scalable data solutions using AWS infrastructure
- Manage and optimize workflows and data processing using tools like Apache Airflow and Apache Spark
- Stay informed on industry trends and best practices, integrating them into the Data Software Engineering processes
- Offer on-call support for data pipelines and datamarts to ensure smooth operations
- Guide the development and deployment of REST APIs for seamless data integration and communication
- Work directly with clients to understand their needs and provide tailored, effective solutions
- Oversee team organization and structure to ensure projects are delivered on time and within scope
- Collaborate with stakeholders, demonstrating strong leadership and communication skills
Requirements
- At least 5 years of experience as a Data Software Engineer, with a focus on large-scale and complex data infrastructures
- A minimum of 1 year of experience leading and managing a team of Data Software Engineers
- Expertise in AWS, including designing and implementing scalable data solutions
- Advanced knowledge of Apache Airflow and Apache Spark for managing workflows and data processing
- Proficiency in CI/CD tools like Jenkins to streamline data pipeline delivery
- Strong skills in Python and SQL for developing and maintaining data pipelines and ETL processes
- Experience with Databricks and PySpark for data analysis and processing
- Familiarity with REST APIs for efficient data integration and communication
- Excellent problem-solving and analytical skills for navigating complex environments
- Strong client-facing abilities to foster collaboration and achieve project goals
- Exceptional organizational and leadership skills to ensure the efficient delivery of projects
- Upper-intermediate English proficiency for effective communication and presentations with stakeholders
Nice to have
- Experience with Redshift for data warehousing and analysis