Senior Data Engineer
Remote in Portugal
Data Software Engineering
& 5 others
Portugal
We are seeking a highly skilled Senior Data Engineer with expertise in Python and AWS to join our growing team.
In this role, you will play a critical part in building and optimizing data pipelines, enabling efficient data workflows, and ensuring data quality across the organization. You will collaborate with cross-functional teams to deliver scalable and high-performance solutions that meet business needs.
Responsibilities
- Design, develop, and maintain scalable data pipelines and workflows
- Collaborate with data scientists, analysts, and other stakeholders to ensure data availability and reliability
- Implement robust data integration processes to handle diverse data sources and formats
- Optimize data storage and retrieval for performance and scalability
- Ensure data quality through monitoring, validation, and error handling mechanisms
- Contribute to the design and implementation of data architecture to support business goals
- Participate in Agile development processes to deliver high-quality solutions within defined timelines
Requirements
- A minimum of 3 years of experience in a Data Engineering role
- Strong programming skills in Python for data processing and automation
- Hands-on experience with CI/CD tools such as Terraform for deployment automation
- Proficiency in AWS services for data engineering, including but not limited to S3, Lambda, Glue, and Redshift
- Advanced SQL skills for querying and managing relational databases
- Experience with distributed data processing frameworks such as Spark
- Fluent English skills, both written and spoken, at a B2 level or higher
Nice to have
- Experience working with Databricks or Snowflake for data processing and analytics
- Familiarity with advanced data engineering tools and platforms
We offer/Benefits
- International projects with top brands
- Work with global teams of highly skilled, diverse peers
- Healthcare benefits
- Employee financial programs
- Paid time off and sick leave
- Upskilling, reskilling and certification courses
- Unlimited access to the LinkedIn Learning library and 22,000+ courses
- Global career opportunities
- Volunteer and community involvement opportunities
- EPAM Employee Groups
- Award-winning culture recognized by Glassdoor, Newsweek and LinkedIn