Skip To Main Content
epam-logo-black.svgepam-logo-black.svg
backBack to Search

Lead Data Software Engineer

Portugal
Data Software Engineering, Azure Databricks, Azure DevOps, Azure Event Hubs, Databricks Unity Catalog, PySpark, Terraform

We are looking for a Lead Data Software Engineer to become an integral part of our energetic team.

In this position, you will create and enhance powerful data solutions to cater to our broad customer base. You will utilize your skills in Python, PySpark, and Azure technologies to drive our products towards enhanced performance and expanded scalability.

Responsibilities
  • Develop and enhance scalable data products targeting a wide consumer audience
  • Enhance and fine-tune data pipelines utilizing Python and PySpark
  • Manage and streamline Azure Databricks environments
  • Employ Azure DevOps pipelines and/or GitHub Actions for efficient data solutions deployment
  • Work closely with interdisciplinary teams to convert business requirements into technical specifications
  • Follow software engineering best practices throughout the project cycle
  • Participate in the expansion and upkeep of the Databricks Unity Catalog
  • Advance data processing and storage solutions in the Azure data ecosystem
Requirements
  • Minimum of 5 years’ experience in the field of data software engineering
  • Over 1 year of proven leadership experience
  • Proficiency in Python and PySpark, with a proven history of developing large-scale data products
  • Competency in deploying and maintaining Azure Databricks solutions
  • Qualifications in managing pipelines via Azure DevOps and/or GitHub Actions
  • Understanding of the Azure data environment, including Azure Event Hubs and Terraform
  • Fluent in English with B2+ level communication skills
Nice to have
  • Capability to develop APIs using Python
  • Experience with Google Cloud Platform (GCP)
Benefits
  • International projects with top brands
  • Work with global teams of highly skilled, diverse peers
  • Healthcare benefits
  • Employee financial programs
  • Paid time off and sick leave
  • Upskilling, reskilling and certification courses
  • Unlimited access to the LinkedIn Learning library and 22,000+ courses
  • Global career opportunities
  • Volunteer and community involvement opportunities
  • EPAM Employee Groups
  • Award-winning culture recognized by Glassdoor, Newsweek and LinkedIn