GO TO SEARCHSenior Data Engineer
Data Software Engineering, Azure Databricks, Azure DevOps, Azure Event Hubs, Databricks Unity Catalog, PySpark, Terraform
We are seeking a highly skilled and motivated Senior Data Engineer to join our team.
The ideal candidate will be responsible for maintaining existing data systems, enhancing our current Data Platform, and implementing future changes as our clients' consumption needs and ingestion evolve. This role requires expertise in handling complex datasets and collaborating with senior team members on high-impact projects.
Responsibilities
- Maintain and enhance existing data systems
- Develop enhancements for the existing Data Platform
- Implement future changes to accommodate growing consumption needs and ingestion
- Work with complex datasets, including the addition of new datasets from scratch
- Collaborate with senior team members on complex projects, particularly when adding new large datasets
- Grow with the technological landscape, adapting to new tools and methodologies as they emerge
- Ensure data quality and integrity in all solutions delivered
- Optimize data retrieval and data storage processes
- Conduct data analysis and provide insights to inform business decisions
Requirements
- 3+ years of experience in Data Software Engineering
- Proficiency in PySpark
- Experience with Azure Databricks, Azure DevOps, and Azure Event Hubs
- Knowledge of the Azure cloud stack
- Experience working with large and complex datasets
- Ability to work in a team and collaborate with various stakeholders
- Familiarity with Databricks Unity Catalog and Terraform
- Strong problem-solving skills and attention to detail
- Fluent English communication skills at a B2+ level
Nice to have
- Experience in Azure Analytics Engineering
- Familiarity with DevOps practices