Back to SearchSenior Data Engineer
Sorry, this position is no longer available
We are looking for an experienced Senior Data Engineer to join our team. You will be responsible for designing and building scalable data pipelines to process and analyze large volumes of data using Scala, Azure Databricks, and Apache Spark.
Responsibilities
- Work with stakeholders including the Product, Data and Engineering teams to assist with data-related technical issues and support their data infrastructure needs
- Adhere to and ensure engineering best practices using modern SDLC that enables CI/CD and favors automation, auditability, automated testing, infrastructure, and policy as code
- Ability to collaborate effectively with other architects and engineers delivering end to end, high-performing, highly reliable, scalable, and operable solutions
- Create and maintain optimal data pipeline architecture to assemble large, complex data sets that meet functional / non-functional business requirements
Requirements
- 3+ years of experience delivering data engineering applications and services
- 3+ years strong hands on experience on Spark , Scala
- Experience building and optimizing ‘big data’ data pipelines, architectures and data sets
- Experience working with modern data pipeline orchestration tools, Airflow preferred, to create complex ETL pipeline jobs
- Good in Agile development methodology, Scrum in particular
- Experience with Databricks
- Working knowledge of Azure
Benefits
- International projects with top brands
- Work with global teams of highly skilled, diverse peers
- Healthcare benefits
- Employee financial programs
- Paid time off and sick leave
- Upskilling, reskilling and certification courses
- Unlimited access to the LinkedIn Learning library and 22,000+ courses
- Global career opportunities
- Volunteer and community involvement opportunities
- EPAM Employee Groups
- Award-winning culture recognized by Glassdoor, Newsweek and LinkedIn