Back to SearchLead Big Data Engineer with Databricks
Remote in India
Data Software Engineering
& 6 others
Sorry, this position is no longer available
India
We are seeking a remote Lead Big Data Engineer with expertise in Databricks to join our team.
The successful candidate will be responsible for designing and implementing solutions utilizing Data Lake and stream processing engines like Kafka and Spark. The Lead Big Data Engineer will have experience in the Financial services domain and will be proficient in software development lifecycle (SDLC) methodologies like Agile and Test-driven development.
Responsibilities
- Designing and implementing solutions utilizing Data Lake and stream processing engines like Kafka and Spark
- Providing technical leadership and guidance to team members
- Collaborating with cross-functional teams to drive projects to completion
- Developing and implementing SDLC methodologies like Agile and Test-driven development
- Maintaining and improving the performance of existing solutions
Requirements
- Bachelor's/Master's Degree in Computer Science, Information Systems or equivalent
- 5+ years of relevant experience in Data Software Engineering
- 1+ years of relevant leadership experience
- Expertise in Databricks, Python, AWS, Apache Spark, and Data Warehousing
- Experience with Big Data platforms such as Apache Hadoop
- Advanced SQL coding skills with both SQL and NoSQL databases
- B2+ English level
Nice to have
- Experience with Apache Airflow, and Relational Database Design
Benefits
- International projects with top brands
- Work with global teams of highly skilled, diverse peers
- Healthcare benefits
- Employee financial programs
- Paid time off and sick leave
- Upskilling, reskilling and certification courses
- Unlimited access to the LinkedIn Learning library and 22,000+ courses
- Global career opportunities
- Volunteer and community involvement opportunities
- EPAM Employee Groups
- Award-winning culture recognized by Glassdoor, Newsweek and LinkedIn