Skip To Main Content
epam-logo-black.svgepam-logo-black.svg
backBack to Search

Senior Data Platform Engineer

Portugal
Data Software Engineering, Azure Databricks, Azure DevOps, Azure Event Hubs, Databricks Unity Catalog, PySpark, Terraform

We are looking for a Senior Data Platform Engineer to join our dynamic team as we tackle exciting challenges such as cloud spending, pipeline performance, and data monitoring.

Our team is tasked with delivering high-quality Data Products that support mission-critical use cases including Fleet Diagnostics, Process Efficiency, and Availability Reporting. The successful candidates will be instrumental in the evolution and maintenance of existing pipelines and the onboarding of new projects during our migration to Azure.

Responsibilities
  • Keep current data systems and pipelines up to date and functioning optimally
  • Tackle new and complex data issues in the Generated Business Record (Gold layer)
  • Implement changes necessitated by new requirements from Data Consumers or the Platform team
  • Enhance and modify our existing Data Platform
  • Organize the integration and processing of complex datasets, including building datasets from scratch
  • Collaborate with team members on complex projects, particularly when merging significant new datasets
  • Adapt to technological advancements by adopting new tools and methods as needed
Requirements
  • A minimum of 3 years of relevant work experience in data engineering or a related field
  • Proficiency in PySpark
  • Background in cloud computing, with a focus on Azure infrastructure
  • Prior handling of large and complex datasets
  • Capability to collaborate with various stakeholders within the team
  • Understanding of pipeline performance optimization and orchestration
  • Flexibility to handle data monitoring and root cause analysis within datasets
  • Fluent English communication skills at a B2+ level
Nice to have
  • Azure Analytics Engineering expertise
  • Understanding of Azure DevOps practices
Benefits
  • International projects with top brands
  • Work with global teams of highly skilled, diverse peers
  • Healthcare benefits
  • Employee financial programs
  • Paid time off and sick leave
  • Upskilling, reskilling and certification courses
  • Unlimited access to the LinkedIn Learning library and 22,000+ courses
  • Global career opportunities
  • Volunteer and community involvement opportunities
  • EPAM Employee Groups
  • Award-winning culture recognized by Glassdoor, Newsweek and LinkedIn