Skip To Main Content
epam-logo-black.svgepam-logo-black.svg
backBack to Search

Lead Data DevOps Engineer (Databricks, Access Management)

Portugal
Data DevOps, Data Access Control, Databricks, Databricks Unity Catalog, Microsoft Azure, Python, SQL, Azure DevOps, REST API

We are looking for an exceptional Lead Data DevOps Engineer to join our Data Consumption (End-to-End) team and play a vital role.

In this role, you will interact mainly with Databricks, Unity Catalog, SQL, Python, and CI/CD tools. Your primary responsibilities will include developing and deploying trusted access and governance frameworks, enhancing audit logging processes, and collaborating with domain experts to develop cutting-edge data solutions.

Responsibilities
  • Sustain and enhance Databricks Unity Catalog with intricate authorization settings for comprehensive global access management
  • Establish systems for traceable and auditable data access utilizing sophisticated platform logging methods
  • Streamline repetitive data-related operations through CI/CD pipelines
  • Ensure smooth coordination with other development teams
  • Develop and maintain Python and SQL codebases for reliable data access systems
  • Collaborate with domain experts to integrate business logic into solution frameworks
Requirements
  • 5+ years of experience in Data DevOps engineering
  • 1+ years of applicable leadership experience
  • Competency in Databricks, Unity Catalog, SQL, Python
  • Proficiency with CI/CD tools, with an emphasis on Azure DevOps
  • Familiarity with Azure Data Platform and core cloud concepts including data storage, compute, and security
  • Understanding of design patterns, microservice architecture, network authentication, and security systems
  • Background in managing large-scale data projects and following data engineering best practices
  • Skills in effective teamwork for seamless execution collaboration
  • Flexibility to develop solutions that meet business requirements and integrate with existing systems
  • Expertise in collaborating with domain specialists to incorporate business logic into designs
  • Experience with Agile and Scrum methodologies
  • Strong communication capabilities for efficient stakeholder interaction
  • A proactive and service-focused approach emphasizing continual enhancement
Benefits
  • International projects with top brands
  • Work with global teams of highly skilled, diverse peers
  • Healthcare benefits
  • Employee financial programs
  • Paid time off and sick leave
  • Upskilling, reskilling and certification courses
  • Unlimited access to the LinkedIn Learning library and 22,000+ courses
  • Global career opportunities
  • Volunteer and community involvement opportunities
  • EPAM Employee Groups
  • Award-winning culture recognized by Glassdoor, Newsweek and LinkedIn