Senior Data Engineer
Data Software Engineering, Azure Databricks, Azure DevOps, Azure Event Hubs, Databricks Unity Catalog, PySpark, Terraform
We are currently in need of a proficient Senior Data Engineer to become part of our team.
The perfect candidate will oversee the maintenance and improvement of our existing data systems, implement necessary modifications to support our client's changing data needs and intake requirements. Furthermore, this role requires handling intricate datasets, crafting improvements for our data infrastructure, and teaming up on sophisticated projects within a rapidly evolving tech environment.
Responsibilities
- Oversee and improve current data systems
- Craft enhancements for our Data Platform
- Execute necessary modifications for expanding data needs and intake
- Handle intricate datasets including crafting new datasets from inception
- Team up with senior team members on intricate projects involving extensive datasets
- Adapt seamlessly to new tools and methods in the ever-changing tech scene
Requirements
- At least 3 years of professional experience in a relevant field
- Proficiency in PySpark
- Knowledge of the Azure Cloud stack, including Azure Databricks and Azure DevOps
- Capability to handle large and complex datasets
- Background in Azure Analytics Engineering
- Familiarity with DevOps practices including Terraform usage
- Fluent English communication skills at a B2+ level
Nice to have
- Experience with Azure Event Hubs
- Competency in Databricks Unity Catalog
Benefits
- International projects with top brands
- Work with global teams of highly skilled, diverse peers
- Healthcare benefits
- Employee financial programs
- Paid time off and sick leave
- Upskilling, reskilling and certification courses
- Unlimited access to the LinkedIn Learning library and 22,000+ courses
- Global career opportunities
- Volunteer and community involvement opportunities
- EPAM Employee Groups
- Award-winning culture recognized by Glassdoor, Newsweek and LinkedIn