We are seeking an open-minded Lead Data Software Engineer to drive the development and maintenance of our data-driven architecture.
In this role, you will work on developing pipelines to build business-related data products and designing cloud-based platform solutions to support DataHub functionality.
If you’re passionate about shaping the future of data engineering and thrive in an environment where innovation and collaboration are key, we invite you to join us.
Responsibilities
- Design and implement data pipelines
- Perform data ingestion processes to integrate existing data sources into the new platform
- Participate in platform engineering, including cloud-based solutions to support the architecture, such as ingestion frameworks, platform orchestrators and exploratory environments
- Conduct MLOps activities to build production-ready cloud-based solutions to support existing ML pipelines
- Take part in the design of on-premises to cloud migration activities
Requirements
- Strong experience in Java, Python or Scala
- Proficiency in SQL
- Understanding of common Big Data challenges (splitability, massive parallel processing, load-balancing, data locality, streaming, etc.) and relevant technologies (Apache Spark, Kafka, NoSQL databases)
- Familiarity with data modeling concepts such as relational/dimensional data, SCD and snowflaking
- Hands-on experience with any major cloud provider: Azure, AWS or GCP
- B2 English level, both verbal and written
Looking for something else?
Find a vacancy that works for you. Send us your CV to receive a personalized offer.
Find me a job