Back to SearchLead Data Software Engineer with Databricks
Remote in India
Data Software Engineering
& 6 others
Sorry, this position is no longer available
India
We are seeking a highly skilled remote Lead Data Software Engineer with expertise in Databricks to support our Data Science teams.
The ideal candidate should possess substantial experience in managing data tools and infrastructure. They will work closely with end-users and stakeholders to create data models, build ETL pipelines, and assist in data integration and modeling initiatives. This role requires a results-driven Data Engineer who can easily multitask between ongoing projects and on-call support.
Responsibilities
- Support Data Science teams by building tables, handling incoming support tickets, and mentoring existing FTE team
- Build Datamarts, develop data models, and provide analytics support
- Follow development sprints based on requirements from Data Scientists
- Building ingestion pipelines and generating documentation to support end-users
- Must be available for on-call support
Requirements
- Minimum 5 years experience in Data Engineering
- 1+ years of relevant leadership experience
- High proficiency in SQL, DSE Python, AWS, and Databricks
- Extensive knowledge of Spark, Python (PySpark, writing on top of Airflow), and Airflow
- Experience with Data integration and modeling, and REST APIs
- Knowledge of AWS suite and ETL pipeline building
- Upper-intermediate level of English language proficiency (B2+)
Nice to have
- Experience working with Apache Spark, Scala, and Apache Airflow
- Understanding of varied forms of data infrastructure, including column stores, relational databases, and Redshift
- Proven track record of publishing user documentation to complement provided information and tools
Benefits
- International projects with top brands
- Work with global teams of highly skilled, diverse peers
- Healthcare benefits
- Employee financial programs
- Paid time off and sick leave
- Upskilling, reskilling and certification courses
- Unlimited access to the LinkedIn Learning library and 22,000+ courses
- Global career opportunities
- Volunteer and community involvement opportunities
- EPAM Employee Groups
- Award-winning culture recognized by Glassdoor, Newsweek and LinkedIn