Back to SearchSenior Data Software Engineer
Remote in Portugal
Data Software Engineering
& 6 others
Choose an option
We are seeking a Senior Data Software Engineer to join our remote team, working on a cutting-edge project in the e2e payment process domain. As a Senior Data Software Engineer you will be responsible for developing and maintaining data processing pipelines and data storage solutions for various data sources. You will work with a cross-functional team to gather, transform and store data for reporting needs. If you are passionate about data engineering and have a strong background in AWS, Python and Apache Airflow, we invite you to be part of our team.
Responsibilities
- Design and develop scalable and reliable data pipelines and infrastructure
- Optimize data processing pipelines for performance and scalability
- Design and implement data storage solutions
- Ensure data quality and integrity by implementing data validation and testing procedures
- Collaborate with cross-functional teams to gather data from various sources and transform it for reporting needs
- Develop and maintain documentation of data pipelines and infrastructure
- Provide technical guidance and mentorship to junior team members
Requirements
- A minimum of 3 years of experience in Data Software Engineering, demonstrating your expertise in data processing and storage solutions
- Strong experience with AWS services, including EC2, S3, Lambda and RDS
- Proficiency in Apache Spark, PySpark and Apache Airflow, enabling you to develop and maintain data processing pipelines
- Experience with Python and Snowflake, allowing you to store and manage large amounts of data
- Strong experience with Kafka, enabling you to build real-time data processing pipelines
- Fluent spoken and written English at an Upper-Intermediate level or higher, enabling effective communication
Nice to have
- Experience with data visualization tools, such as Tableau or Power BI
- Experience with data governance and security best practices