Back to SearchSenior Big Data Developer
Remote in Portugal
Data Software Engineering
& 8 others
Choose an option
We are looking for an experienced remote Senior Big Data Developer to join our team.
As an ideal candidate, you should have extensive knowledge of Data Software Engineering, Snowflake, AWS, Python, and Apache Spark. You will be responsible for developing PySpark ETL pipelines, configuring Kafka connectors, and building Jenkins pipelines.
Responsibilities
- Develop PySpark ETL pipelines and configure Kafka connectors
- Build Jenkins pipelines for schedulers, CI/CD, etc.
- Work with Kafka UI and other relevant tools such as Python 3.7, PySpark SQL, Jenkins, Artifactory, Sonar, and Atlassian tools
- Collaborate with cross-functional teams to determine project requirements and deliverables
- Troubleshoot and debug applications as needed
Requirements
- 3+ years of relevant experience as a Big Data Developer or Data Engineer
- Strong skills in Snowflake, AWS, and Spark
- Knowledge of Python
- Hands-on experience with Kubernetes/Docker and Jenkins pipeline
- Knowledge of Kafka Connect Cluster and Atlassian tools (Bitbucket, Jira, Confluence)
- Good English communication skills (B2+)
Nice to have
- Familiarity with PyCharm IDE