Principal Data Software Engineer (Databricks)

Office in Spain: Málaga, Spain: Madrid

Data Software Engineering

Location-specific conditions & benefits*

Choose an option

We are looking for a Principal Data Software Engineer with experience and knowledge in Databricks and open-minded personality, who can join our friendly environment and become a core contributor to our team of experts.

Do you have background and wide experience in Data engineering and strong knowledge in Databricks? Are you an open-minded professional with good English skills? If it sounds like you, this could be the perfect opportunity to join EPAM as a Principal Data Software Engineer.

Responsibilities

Design, develop, and maintain scalable data pipelines and robust data architectures
Optimize data models and ETL processes specifically using Databricks and complementary technologies
Implement rigorous data quality checks and monitoring systems to uphold high data integrity
Keep abreast of emerging trends and technologies in data engineering, advocating for the integration of advantageous new tools
Troubleshoot and efficiently resolve data-related issues
Conduct code reviews to ensure adherence to high standards of code quality
Drive technology initiatives, including technology designs, proof of concept, research and development
Streamline project processes when necessary to promote excellence in data engineering practices
Foster transparent, effective communication with team members and clients to justify and discuss technical solutions

Requirements

Proven expertise in Spark (either using Scala or PySpark)
Strong background in data architecture and data modeling, along with building ETL pipelines using Databricks
Experience with multiple SDLC phases across various projects, and demonstrated technical leadership over complex implementations
Proficiency in cloud-native technologies including containerization, and software engineering best practices like unit testing and linting
Engineering background with one or more major cloud platforms: AWS, Azure, or GCP
Skillful at performance optimization for data-intensive applications
Keen follower of technological advancements with a knack for modernizing legacy systems
Proven ability to present and advocate for technical solutions to stakeholders
Independent problem solver comfortable with ambiguity
Highly proactive with evident client-facing experience
Fluent English communication skills with a minimum of B2+ level

Looking for something else?

Find a vacancy that works for you. Send us your CV to receive a personalized offer.

Find me a job