Principal Data Software Engineer (Databricks)

Remote in Spain

Data Software Engineering

We are looking for a Principal Data Software Engineer who possesses expertise in Databricks and has a proactive, open-minded approach. This role offers the opportunity to become a pivotal member of our expert team, making significant contributions in a collaborative environment.

Do you have background and wide experience in Data engineering and strong knowledge in Databricks? Are you an open-minded professional with good English skills? If it sounds like you, this could be the perfect opportunity to join EPAM as a Principal Data Software Engineer.

Responsibilities

Design, develop, and maintain scalable data pipelines and robust data architectures
Optimize data models and ETL processes using Databricks and complementary technologies
Implement data quality checks and monitoring systems to maintain high data integrity
Stay current with emerging trends and technologies in data engineering, and advocate for the integration of new tools
Troubleshoot and resolve data-related issues efficiently
Conduct code reviews to ensure high standards of code quality are maintained
Drive technology initiatives, including designs, proof of concept, and research and development
Streamline project processes to enhance data engineering practices
Foster transparent and effective communication with team members and clients to justify and discuss technical solutions

Requirements

Proven expertise in Spark, using either Scala or PySpark
Strong background in data architecture, data modeling, and building ETL pipelines using Databricks
Experience with multiple SDLC phases and technical leadership over complex implementations
Proficiency in cloud-native technologies and software engineering best practices including unit testing and linting
Engineering background in at least one major cloud platform: AWS, Azure, or GCP
Skillful in performance optimization for data-intensive applications
Keen on technological advancements and modernizing legacy systems
Proven ability to present and advocate for technical solutions to stakeholders
Independent problem-solving skills and comfort with ambiguity
Highly proactive with evident client-facing experience
Fluent English communication skills, minimum B2+ level

Looking for something else?

Find a vacancy that works for you. Send us your CV to receive a personalized offer.

Find me a job