Back to SearchSenior Data Software Engineer
Remote in Portugal
Data Software Engineering
& 6 others
Choose an option
We are seeking a highly experienced Senior Data Software Engineer to join our remote team and work on innovative projects for our client, a retail pharmacy juggernaut with a presence in nine countries. In this role you will be responsible for designing, developing and maintaining data pipelines, ensuring robust, scalable and reusable solutions are delivered. If you have a passion for big data, a robust technical skill set, and a drive to deliver high-quality solutions, we encourage you to apply.
Responsibilities
- Design, develop and maintain scalable and high-performance data solutions that meet the needs of our clients
- Automate data extraction, transformation and provisioning irrespective of the type of source and target
- Collaborate with cross-functional teams to conceptualize, design and implement effective data solutions
- Ensure data quality and integrity, identifying and troubleshooting data issues promptly
- Optimize and fine-tune data processes to ensure enhanced performance and scalability
- Develop and maintain technical documentation for data solutions
- Stay up-to-date with emerging trends in data software engineering and identify opportunities to improve existing systems
Requirements
- Minimum of 3 years of relevant work experience in a Data Software Engineer role with expertise in AWS and Snowflake
- Experience with structured and unstructured data, as well as big data concepts
- Advanced knowledge of SQL, including complex data merging techniques such as windowing functions, and Hive concepts, partitioning, and bucketing
- Familiarity with big data concepts, HDFS and overall distributed architecture understanding
- Work experience with at least one NoSQL database and expertise in Spark, Spark streaming and Performance Tuning in Spark
- Experience with Unit Testing and Mocking Framework, as well as advanced Python programming concepts
- Fluent English language skills with an Upper-Intermediate level
Nice to have
- Good experience in test automation and relative tools and frameworks, like Pytest, Behave, Lettuce, etc
- Experience with Kubernetes (high level) and Docker