Senior Data Software Engineer (Databricks)
Remote in Spain
Data Software Engineering
& 5 others
We are looking for a Senior Data Software Engineer with a strong background in Databricks to join our team.
The ideal candidate will be an open-minded professional, well-versed in data engineering, who can effortlessly integrate into our friendly work environment and contribute significantly to our projects.
Responsibilities
- Design, develop, and maintain scalable data pipelines and architectures
- Optimize data models and ETL processes using Databricks and other relevant technologies
- Implement data quality checks and monitoring to ensure high data integrity
- Stay abreast of emerging trends and technologies in data engineering, proposing new tools where beneficial
- Troubleshoot and resolve data-related issues promptly
- Participate in code reviews to maintain high standards of code quality
- Collaborate with other team members and stakeholders to enhance data-driven decisions
- Mentor junior data engineers and share knowledge within the team
- Contribute to the continuous improvement of our data engineering practices and procedures
Requirements
- Hands-on experience with Databricks: Delta Lake, workflows, Delta Live Tables, deployment, and versioning
- Solid understanding of data architectures and strong data modeling skills
- Proficiency in Spark (either Scala or PySpark)
- Expertise in designing and building ETL pipelines with Databricks using external orchestrators like Airflow
- Experience with cloud-native technologies, containers, and software engineering best practices including unit tests, linting, and code style checks
- Engineering background with either AWS, Azure, or GCP
- Familiarity with big data and performance optimization of data-intensive applications
- Proactivity and experience in client-facing roles
- Ability to work independently in ambiguous situations
- Desire to function effectively in a transparent, fast-moving startup environment
- Fluent English communication skills at a B2+ level
Looking for something else?
Find a vacancy that works for you. Send us your CV to receive a personalized offer.
Find me a job