Back to SearchLead Data Integration Developer
Data Integration
& 3 others
Sorry, this position is no longer available
Brazil
We are looking for a Lead Data Integration Developer to join our remote team.
You will be responsible for creating and enhancing data products and utilizing the newly created Snowflake-based cloud data platform to store data from various sources batch/real-time and applying business logic to create value from this input data. Your primary focus will involve working on an exciting business area that mainly uses Databricks. You will participate in one or multiple steps of the entire data product delivery process, depending on your skills and capabilities. Fluency in both English and Portuguese languages is required for this role.
Responsibilities
- Design and maintain efficient, reliable, and scalable data pipelines using Azure Data Factory, Python, Snowflake, and other technologies
- Collaborate with cross-functional teams to gather requirements and develop data integration solutions
- Lead a team of developers, providing mentorship and guidance on technical challenges
- Improve data quality and accuracy, identifying and resolving data quality issues
- Develop and maintain documentation for data pipelines, data models, and data processing workflows
- Create and execute test plans to ensure data accuracy, consistency, and reliability
- Identify opportunities for process and tool improvements to reduce development time and increase efficiency
Requirements
- Minimum of 5 years experience in Data Integration
- Proven track record of leading and mentoring a team of engineers
- Hands-on experience in Azure Data Factory and Python
- Strong proficiency in Snowflake database, including its SQL dialects and schema design principles
- Experience with data pipeline and workflow management tools, such as Apache Airflow
- Proficiency in Kafka and Windows Server VMs
- Experience with big data technologies, such as Hadoop, Spark, and Databricks
- Good understanding of data modeling, data access, and data storage techniques
- Excellent problem-solving skills with a keen eye for detail
- Ability to work independently and lead a team of developers
- Upper-intermediate level of English language proficiency
- Knowledge of Portuguese language
Nice to have
- Experience with cloud-based platforms
Benefits
- International projects with top brands
- Work with global teams of highly skilled, diverse peers
- Healthcare benefits
- Employee financial programs
- Paid time off and sick leave
- Upskilling, reskilling and certification courses
- Unlimited access to the LinkedIn Learning library and 22,000+ courses
- Global career opportunities
- Volunteer and community involvement opportunities
- EPAM Employee Groups
- Award-winning culture recognized by Glassdoor, Newsweek and LinkedIn