Lead Data Software Engineer (Databricks)

Remote in Spain

Data Software Engineering

We are looking for a Lead Data Software Engineer with a strong background in Databricks and an open-minded personality. This role requires someone ready to join a friendly environment and become a core contributor to our team of experts.

Do you have background and wide experience in Data engineering and strong knowledge in Databricks? Are you an open-minded professional with good English skills? If it sounds like you, this could be the perfect opportunity to join EPAM as a Lead Data Software Engineer.

Responsibilities

Lead a small team of engineers in designing, developing, and maintaining scalable data pipelines and architectures
Develop and optimize data models and ETL processes using Databricks and other technologies
Implement data quality checks and monitoring to ensure high data integrity
Stay updated with emerging trends in data engineering and recommend new tools when beneficial
Troubleshoot and resolve data-related issues promptly
Participate in code reviews to maintain high standards of code quality

Requirements

Hands-on experience with Databricks, including Delta Lake, workflows, Delta Live Tables, deployment, and versioning
Ability to lead a development team of 2-5 engineers
Solid understanding of data architectures and data modelling; experienced in designing and building ETL pipelines with Databricks
Expertise in Spark using (either Scala or PySpark)
Knowledge of SDLC and Agile frameworks
Proficiency in cloud-native technologies and software engineering best practices, including containers, unit tests, linting, and code style checks
Engineering experience with AWS, Azure, or GCP
Experience with big data and performance optimization of data-intensive applications
Proactivity and client-facing experience
Ability to deal with ambiguity and work independently
Desire to work in a transparent and fast-moving startup environment
Fluent in English communication skills at a B2+ level

Looking for something else?

Find a vacancy that works for you. Send us your CV to receive a personalized offer.

Find me a job