Back to SearchLead Data Engineer with Databricks
Remote in Colombia
Data Software Engineering
& 4 others
Sorry, this position is no longer available
Colombia
We are seeking a remote Lead Data Engineer with expertise in Databricks to join our team.
The ideal candidate will be responsible for designing, developing, and implementing data engineering solutions using Azure Data Factory, Databricks, Python, and SQL. The candidate must have excellent analytical and problem-solving skills, as well as strong communication and collaboration skills. The successful candidate will work with big data technologies such as Hadoop, Hive, Spark, or Kafka.
Responsibilities
- Design, develop, and implement data engineering solutions using Azure Data Factory, Databricks, Python, and SQL
- Build and optimize data pipelines, data ingestion, and data transformation processes
- Create technical documentation for data engineering solutions, data flows, and data models
- Collaborate with the team to identify and resolve complex data engineering issues
- Provide coaching and guidance for junior data engineers on the team
Requirements
- Minimum of 5 years of experience in developing Data Software Engineering solutions using Azure Data Factory, Python, and SQL
- 1+ years of relevant leadership experience
- Experience with cloud-based platforms and technologies such as Azure, AWS, or GCP
- Strong proficiency in Databricks
- Experience working with Big Data technologies such as Hadoop, Hive, Spark, or Kafka
- Upper-Intermediate English level (B2+)
Nice to have
- Experience with NoSQL databases
- Experience with machine learning frameworks
Benefits
- International projects with top brands
- Work with global teams of highly skilled, diverse peers
- Healthcare benefits
- Employee financial programs
- Paid time off and sick leave
- Upskilling, reskilling and certification courses
- Unlimited access to the LinkedIn Learning library and 22,000+ courses
- Global career opportunities
- Volunteer and community involvement opportunities
- EPAM Employee Groups
- Award-winning culture recognized by Glassdoor, Newsweek and LinkedIn