Skip To Main Content
epam-logo-black.svgepam-logo-black.svg
backBack to Search

Data Platform Engineer

Portugal
Data Software Engineering, Azure Databricks, Azure DevOps, Azure Event Hubs, Databricks Unity Catalog, PySpark, Terraform

We are seeking a Data Platform Engineer to join our dynamic team as we address exciting challenges like cloud spending, pipeline performance, and data monitoring.

Our team is responsible for delivering high-quality Data Products that enhance mission-critical use cases such as Fleet Diagnostics, Process Efficiency, and Availability Reporting. The selected candidates will play a crucial role in the development and support of existing pipelines and the implementation of new demands as we migrate workloads to Azure.

Responsibilities
  • Maintain and enhance existing data systems and pipelines
  • Analyze and resolve new and complex data issues in the Generated Business Record (Gold layer)
  • Adapt and implement changes driven by new demands from Data Consumers or from the Platform team
  • Develop modifications and enhancements for our current Data Platform
  • Manage the integration and processing of complex datasets, including the creation of datasets from scratch
  • Collaborate with team members on elaborate projects, particularly when integrating substantial new datasets
  • Evolve with technological advancements, adopting new tools and methodologies as required
Requirements
  • A minimum of 2 years of relevant working experience in data engineering or a similar field
  • Proficiency in PySpark
  • Background in cloud computing, focusing on Azure infrastructure
  • Previous experience with large and complex dataset handling
  • Capability to work collaboratively with varied stakeholders within the team
  • Understanding of pipeline performance optimization and orchestration
  • Flexibility to manage data monitoring and root cause analysis within datasets
  • Fluent English communication skills at a B2+ level
Nice to have
  • Experience in Azure Analytics Engineering
  • Familiarity with Azure DevOps practices
Benefits
  • International projects with top brands
  • Work with global teams of highly skilled, diverse peers
  • Healthcare benefits
  • Employee financial programs
  • Paid time off and sick leave
  • Upskilling, reskilling and certification courses
  • Unlimited access to the LinkedIn Learning library and 22,000+ courses
  • Global career opportunities
  • Volunteer and community involvement opportunities
  • EPAM Employee Groups
  • Award-winning culture recognized by Glassdoor, Newsweek and LinkedIn