Назад до пошукуSenior Data Engineer
Віддалений* формат співпраці з території - Україна
*Ви можете працювати віддалено з території країни (або країн), для яких відкрита ця позиція.
Data Integration& інші навички
We are seeking a Senior Data Engineer to join our insurance project team.
In this role, you will be responsible for designing and building robust ETL pipelines, ensuring the quality of data deliverables, and supporting data migration efforts. You will collaborate closely with cross-functional teams to lock requirements early, drive quality through developer-led testing, and contribute to the successful delivery of complex data initiatives within the insurance domain.
Чим ви будете займатися у цій ролі
- Develop extraction, transformation, validation, reconciliation, and loading logic in line with approved source-to-target mappings and ETL HLDs
- Own the quality of ETL deliverables by designing, executing, and evidencing developer-led testing before QA involvement
- Create and maintain automated unit tests, component tests, and data validation checks for ETL pipelines
- Validate source-to-target mappings, transformation logic, reconciliation controls, and error-handling scenarios as part of development
- Produce test evidence demonstrating that ETL code meets functional and non-functional requirements prior to promotion
- Support dry runs and test migrations, investigate defects, perform root cause analysis, and implement fixes
- Build ETL jobs that can be re-run safely with clear logging and error handling
- Create and update supporting documentation such as runbooks and technical implementation notes
- Actively participate in ALL scrum ceremonies
- Contribute to the "Three Amigos" discussions (typically BA, QA, Tech Lead) for each ETL story to lock requirements and acceptance criteria early and avoid rework
- Raise and manage technical dependencies early with the Delivery Manager
Навички
- 5+ years of experience in data engineering
- Background in operational data migration
- Expertise in ETL design and build, including migration orchestration
- Proficiency in SQL
- Knowledge of Python and PySpark
- Excellent command of written and spoken English (B2+ level)
Буде перевагою
- Familiarity with Databricks
- Knowledge of PostgreSQL databases
- Experience with AWS S3 buckets
- Understanding of Apache Kafka
- Skills in Java APIs, REST, and SOAP
- Competency in ETL performance optimisation
- Proficiency in Jenkins and Git
- Experience with EIS (Billing v12, ClaimCore v12, CustomerCore v20, PolicyCore v12, EIS Solutions)
- Familiarity with Prometheus and Grafana
- Understanding of the insurance domain, specifically within the UK market