Lead Data Integration Engineer
Hybrid in Portugal: Lisbon
Data Integration
& 4 others
Choose an option
We are seeking a driven and experienced Lead Data Integration Engineer to spearhead efforts in designing and implementing robust data pipelines and scalable data foundations while driving team performance and fostering leadership. This role emphasizes ensuring reliability, optimizing system integration, and delivering high-quality data solutions across diverse platforms, in addition to leading technical teams and strategic initiatives.
Responsibilities
- Lead the design, development, and optimization of end-to-end ETL/ELT pipelines for the entire engineering team
- Design, deploy, and maintain scalable and efficient data architectures supporting organizational growth
- Drive efforts to ensure data quality, reliability, and availability across all platforms for analytics and reporting
- Define and oversee proper storage of data in line with relevant legislation, organizational policies, and compliance standards
- Architect and enforce security, compliance, scalability, efficiency, reliability, fidelity, flexibility, and portability within data solutions
- Collaborate closely with cross-functional leaders and stakeholders to translate business needs into technical solutions
- Drive innovation and decision-making to solve complex integration challenges and ensure alignment with organizational goals
- Provide leadership and mentorship to junior and mid-level data engineers, fostering a culture of continuous improvement and collaboration
- Evaluate emerging technologies and strategies to enhance system integration and data engineering practices
Requirements
- 5+ years of experience in data engineering, integration, or similar roles
- Leadership experience of over 1 year in managing teams and driving organizational change through data solutions
- Certification in relevant technologies (e.g., AWS Certified Data Analytics, Snowflake SnowPro Core Certification) with proven expertise
- Strong background in advanced techniques such as machine learning, data mining, and predictive analytics
- Proven proficiency in executing and implementing data governance and data management best practices to ensure compliance and high-quality data standards
- Expert-level understanding of Agile development methodologies and their application to large-scale projects
- Demonstrated competency in domains such as Finance, Consumer, Commercial, P&C, Supply Chain, Product, and Life Sciences at a leadership level
- Advanced expertise in handling and integrating data from platforms such as Salesforce, DCE (Digital Consumer Engagement), ERP, and Finance Systems
- Extensive showcase of Snowflake expertise: Data warehousing, integration, transformation, optimization, and architecture
- Proficiency in Amazon AWS tools, such as S3, Redshift, Glue, Lambda, EMR, and AWS data services relevant to high-scale data environments
- Strong experience with open-source technologies like Apache Kafka and Apache Spark for event streaming and big data processing
- Mastery of SQL and NoSQL database systems with the ability to design and optimize complex queries
- Track record of leveraging data visualization tools for system monitoring and pipeline optimization
- Advanced knowledge of data security standards, privacy requirements, and compliance frameworks
- Exceptional analytical, problem-solving, and team collaboration skills to foster strategic success
- Strong communication and collaboration skills, with English proficiency at a B2+ level or higher
Nice to have
- Expertise in tools like Data Build Tool (dbt) for advanced data modeling and transformation workflows
- Hands-on experience with Matillion for complex ETL processes and streamlined data transformations