Back to SearchSenior Data Engineer
Hybrid in Ukraine
Data Software Engineering
& 9 others
We are seeking an experienced Senior Data Engineer to join our team.
The project entails the development and optimization of a new Data Platform to adjust our current data processing system. The Senior Data Engineer will be responsible for designing, implementing, and maintaining the platform to meet the business's data needs.
f you have a passion for Data Software Engineering to deliver impactful web applications, we would love to hear from you.
Responsibilities
- Develop data processing pipelines using Azure Data Factory and Azure Functions
- Implement data ingestion and transformation processes using Databricks and PySpark
- Write efficient code in Python and SQL to extract, transform, and load data
- Collaborate with stakeholders to gather requirements and ensure the platform meets business needs
- Monitor and troubleshoot the platform's performance and address any issues
- Implement data quality assurance measures and process improvements
- Optimize data storage and retrieval operations
- Conduct data analysis and generate insights to guide decision-making
- Train and mentor junior Data Engineers
- Participate in peer code reviews and collaborative team activities
Requirements
- 3+ years of hands-on experience in big-data field and expertise in Data Software Engineering
- Strong knowledge and experience with Azure Data Factory, Azure Functions, and Databricks
- Proficiency in PySpark, Python, and SQL
- Understanding of batch processing and ETL principles in Data Warehouses
- Experience with data completeness signals and orchestration
- Knowledge of schema migrations and datasets evolution
- Familiarity with approaches for historical reprocessing and data correction
- Good problem-solving and communication skills
- Proficient in English with a B2+ level, strong speaking English
Nice to have
- Familiarity with Microsoft Power BI
- Competency in Azure Blob Storage, Azure File Storage
Looking for something else?
Find a vacancy that works for you. Send us your CV to receive a personalized offer.
Find me a job